00000001:02000400:3.0F:1789115224.762187:0:2958:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_hostid 00000001:02000400:3.0:1789115242.065636:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789115244.034968:0:3242:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 831 MB/s 00000001:01000000:1.0F:1789115244.285625:0:3242:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 832 MB/s 00000001:01000000:1.0:1789115244.535600:0:3242:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4299 MB/s 00000020:02000000:1.0:1789115245.500658:0:3274:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_142_g748fc9f 00000400:02000000:0.0F:1789115246.382218:0:3289:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.131@tcp [8/256/0/180] 00008000:02000000:0.0:1789115249.931478:0:3438:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789115296.967865:0:5246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789115308.609796:0:5831:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789115308.609802:0:5831:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789115308.609930:0:5831:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005e959b8f 00000080:02000400:3.0:1789115308.609942:0:5831:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789115308.622151:0:5831:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789115308.622164:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789115308.622209:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000e08a49b3) 00000020:00000080:3.0:1789115308.622229:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789115308.703509:0:5831:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789115308.704466:0:5831:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789115308.752970:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789115308.753008:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789115308.753030:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789115308.753081:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789115308.753105:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789115308.754346:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789115308.754357:0:5831:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789115308.754369:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa47abda6516d2de1 00000020:01000004:2.0:1789115308.754377:0:5831:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789115308.755836:0:5831:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789115308.756053:0:5831:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005e959b8f from MGS 00000020:01000004:2.0:1789115308.756059:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789115308.756094:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a2cab663) 00000020:00000080:2.0:1789115308.756111:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789115308.756183:0:5831:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005e959b8f from MGS, refs=2 00080000:01000000:2.0:1789115308.756190:0:5831:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789115308.756196:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa47abda6516d2def 00000100:00100000:2.0:1789115308.756333:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789115308.760832:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789115308.761190:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789115308.765061:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789115308.765075:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789115308.768989:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789115308.769184:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789115308.769190:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789115308.771225:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789115308.771237:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789115308.772252:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789115308.772261:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789115308.773241:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115308.773246:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115308.773247:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115308.773726:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115308.773730:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115308.773731:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115308.774530:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789115308.776498:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789115309.029794:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1570 MB/s 00000001:01000000:1.0:1789115309.283041:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1901 MB/s 00000001:01000000:2.0:1789115309.533706:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 282 MB/s 00000001:01000000:3.0:1789115309.787449:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 310 MB/s 00010000:00010000:3.0:1789115309.799579:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1789115309.801534:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1789115309.817111:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789115309.817128:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789115309.817131:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789115309.817905:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789115309.817954:0:5831:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789115309.817990:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789115309.818223:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789115309.818246:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789115309.818862:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789115309.819016:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789115309.819022:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789115309.819706:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789115309.819714:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789115309.822996:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789115309.823012:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789115309.826432:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789115309.826457:0:5831:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.131@tcp' 00000020:01000004:1.0:1789115309.826459:0:5831:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789115309.826900:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.131@tcp (typ=mgc) 00000020:00000080:1.0:1789115309.826920:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.131@tcp (000000002a3c1e4c) 00000020:00000080:1.0:1789115309.826937:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789115309.827066:0:5831:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000907e6de3@MGC192.168.203.131@tcp: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1789115309.827229:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.131@tcp-0 is initialized 00000040:01000000:1.0:1789115309.827235:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789115309.832890:0:5848:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789115309.832951:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.131@tcp (uuid 2d846835-79f9-4361-81d5-b56fc2e9378a) 00000020:00000080:1.0:1789115309.832976:0:5831:0:(genops.c:1385:class_connect()) connect: client 2d846835-79f9-4361-81d5-b56fc2e9378a, cookie 0xa47abda6516d2dfd 00000100:00080000:1.0:1789115309.832990:0:5831:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789115309.832996:0:5831:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import 00000000907e6de3 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1789115309.833035:0:5831:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cc9d850d x1876023308189824/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789115309.833144:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc9d850d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2d846835-79f9-4361-81d5-b56fc2e9378a:3304:1876023308189824:0@lo:250: 00000100:00100000:1.0:1789115309.833243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789115309.833300:0:5831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2d846835-79f9-4361-81d5-b56fc2e9378a->MGS 00000020:01000004:1.0:1789115309.833321:0:5831:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789115309.833327:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789115309.833341:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000be638822) 00000020:00000080:1.0:1789115309.833355:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789115309.837757:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308189824 00000100:00100000:0.0:1789115309.837771:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308189824 00000100:00100000:0.0:1789115309.837833:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789115309.837842:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b578f77e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1876023308189824:12345-0@lo:250: 00010000:00080000:0.0:1789115309.837873:0:5843:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 2d846835-79f9-4361-81d5-b56fc2e9378a@0@lo t0 exp 0000000000000000 cur 127 last 0 00000020:00000080:0.0:1789115309.837902:0:5843:0:(genops.c:1385:class_connect()) connect: client 2d846835-79f9-4361-81d5-b56fc2e9378a, cookie 0xa47abda6516d2e0b 00000100:00080000:0.0:1789115309.838036:0:5843:0:(import.c:65:import_set_state_nolock()) 0000000026e12873 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789115309.838131:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b578f77e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+5:3304:x1876023308189824:12345-0@lo:250: Request processed in 289us (4888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115309.838140:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789115309.838209:0:3304:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789115309.838220:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.131@tcp: connect to target with instance 0 00000100:00080000:0.0:1789115309.838228:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789115309.838233:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789115309.838236:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000907e6de3 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789115309.838238:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789115309.838248:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789115309.838253:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc9d850d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2d846835-79f9-4361-81d5-b56fc2e9378a:3304:1876023308189824:0@lo:250: 00000100:00080000:2.0:1789115309.839374:0:5847:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1789115309.883492:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789115309.883757:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789115309.883763:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789115309.884678:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789115309.884686:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789115309.885036:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789115309.885042:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789115309.887167:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789115309.887352:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789115309.887358:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789115309.888332:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789115309.888341:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789115309.970629:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789115309.971123:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789115309.971130:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789115309.980466:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789115309.980561:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789115309.986438:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789115309.986951:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789115309.986959:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789115309.987893:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789115309.987902:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789115309.988705:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789115309.988860:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789115309.988872:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789115309.996515:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789115309.996537:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789115309.997303:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789115310.001776:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789115310.001788:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789115310.003893:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789115310.003906:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789115310.054897:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789115310.055124:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789115310.055131:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789115310.057276:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789115310.057289:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789115310.059447:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789115310.059463:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789115310.061150:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789115310.061178:0:5831:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789115310.061187:0:5831:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789115310.061315:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789115310.061355:0:5831:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789115310.061360:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789115310.061362:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789115310.061364:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789115310.061365:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789115310.061366:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789115310.061371:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789115310.061372:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789115310.061374:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789115310.061375:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789115310.061377:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789115310.061378:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789115310.061441:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789115310.061444:0:5831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789115310.061447:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789115310.061448:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789115310.061449:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789115310.061450:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789115310.061451:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789115310.061452:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789115310.061452:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789115310.061454:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789115310.061455:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789115310.061455:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789115310.061456:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789115310.061457:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789115310.061702:0:5831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789115310.061724:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de37434a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308189952:0@lo:253: 00000100:00100000:3.0:1789115310.061818:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115310.061917:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000262ba6a7 going to sleep for 11 seconds 00000100:00100000:1.0:1789115310.062011:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308189952 00000100:00100000:1.0:1789115310.062020:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308189952 00000100:00100000:1.0:1789115310.062116:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789115310.062125:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042c27bc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+5:5831:x1876023308189952:12345-0@lo:253: 20000000:01000000:1.0:1789115310.062177:0:5846:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789115310.062180:0:5846:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789115310.062723:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789115310.062790:0:5846:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789115310.063082:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789115310.064091:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789115310.064288:0:5846:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789115310.064292:0:5846:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789115310.064297:0:5846:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789115310.064300:0:5846:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789115310.064311:0:5846:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789115310.064721:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789115310.064941:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789115310.064953:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789115310.064995:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789115310.065041:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789115310.065075:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789115310.065157:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789115310.065166:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789115310.065208:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789115310.065215:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789115310.065257:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789115310.065264:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789115310.065291:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789115310.065335:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789115310.065363:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789115310.065368:0:5846:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789115310.065413:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789115310.066028:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789115310.066040:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789115310.066075:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789115310.066106:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789115310.066152:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789115310.066163:0:5846:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789115310.066238:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789115310.066246:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789115310.066298:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789115310.066337:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789115310.066370:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789115310.066842:0:5846:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789115310.066960:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789115310.066971:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789115310.067004:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789115310.067038:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789115310.067261:0:5846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789115310.067305:0:5846:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789115310.067312:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789115310.067919:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789115310.069717:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789115310.069745:0:5846:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.131@tcp for mdt 20000000:01000000:2.0:1789115310.069747:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:2.0:1789115310.069781:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789115310.069787:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789115310.069833:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789115310.069840:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:2.0:1789115310.069888:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789115310.069898:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789115310.069928:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789115310.069956:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789115310.070043:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789115310.070047:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789115310.070052:0:5846:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789115310.070058:0:5846:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789115310.072668:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1789115310.072996:0:5846:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789115310.081821:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789115310.081873:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1789115310.081947:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1789115310.081966:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789115310.081969:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789115310.081972:0:5846:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789115310.082034:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789115310.082038:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789115310.082069:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789115310.082072:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789115310.089110:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1789115310.089478:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1789115310.089539:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1789115310.089602:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1789115310.089614:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789115310.089616:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789115310.090049:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789115310.090348:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789115310.090417:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789115310.090457:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1789115310.090469:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789115310.090473:0:5846:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1789115310.090479:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789115310.090522:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d2a6ee26/0xa47abda6516d2e12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.090541:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2a6ee26/0xa47abda6516d2e12 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.090552:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d2a6ee26/0xa47abda6516d2e12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.090558:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d2a6ee26/0xa47abda6516d2e12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.090564:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d2a6ee26/0xa47abda6516d2e12 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.090571:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d2a6ee26/0xa47abda6516d2e12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.090577:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d2a6ee26 already unused, calling callback (000000005be2118e) 00010000:00010000:2.0:1789115310.090581:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d2a6ee26/0xa47abda6516d2e12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.090588:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d2a6ee26/0xa47abda6516d2e12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.090616:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d2a6ee26/0xa47abda6516d2e12 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.090624:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d2a6ee26/0xa47abda6516d2e12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.090629:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d2a6ee26/0xa47abda6516d2e12 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789115310.090647:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789115310.479618:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042c27bc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+5:5831:x1876023308189952:12345-0@lo:253: Request processed in 417488us (417794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115310.479634:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789115310.479753:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de37434a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308189952:0@lo:253: 10000000:01000000:1.0:1789115310.479771:0:5831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789115310.479775:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789115310.479777:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789115310.479778:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789115310.479779:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789115310.479781:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789115310.479782:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789115310.479783:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789115310.479785:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789115310.479787:0:5831:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789115310.479789:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789115310.479790:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789115310.479814:0:5831:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005e959b8f from lustre-MDT0000 10000000:01000000:1.0:1789115310.479842:0:5831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789115310.479845:0:5831:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789115310.479850:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8dfcd92d3490 10000000:01000000:1.0:1789115310.479855:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789115310.479864:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dfcd92d3490 from 1 10000000:01000000:1.0:1789115310.479880:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789115310.479923:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 0000000088d4812d/0xa47abda6516d2e19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115310.479933:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 0000000088d4812d/0xa47abda6516d2e19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115310.479943:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 0000000088d4812d/0xa47abda6516d2e19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115310.479963:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd7628a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308190080:0@lo:101: 00000100:00100000:1.0:1789115310.480015:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115310.480071:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000421a8d85 going to sleep for 11 seconds 00000100:00100000:2.0:1789115310.480217:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308190080 00000100:00100000:2.0:1789115310.480224:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308190080 00000100:00100000:2.0:1789115310.480268:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789115310.480277:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4bd1bf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+5:5831:x1876023308190080:12345-0@lo:101: 00010000:00010000:2.0:1789115310.480293:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115310.480307:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2a6ee26/0xa47abda6516d2e20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2e19 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.480332:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2a6ee26/0xa47abda6516d2e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2e19 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.480342:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2a6ee26/0xa47abda6516d2e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2e19 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.480353:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2a6ee26, rc 0) 00000100:00100000:1.0:1789115310.480580:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4bd1bf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+6:5831:x1876023308190080:12345-0@lo:101: Request processed in 304us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115310.480588:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789115310.480660:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd7628a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308190080:0@lo:101: 00010000:00010000:2.0:1789115310.480674:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 0000000088d4812d/0xa47abda6516d2e19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.480695:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 0000000088d4812d/0xa47abda6516d2e19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2e20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115310.480744:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d0d2856 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308190208:0@lo:501: 00000100:00100000:2.0:1789115310.480772:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115310.480840:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e7b7b1ff going to sleep for 11 seconds 00000100:00100000:0.0:1789115310.480930:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308190208 00000100:00100000:0.0:1789115310.480935:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308190208 00000100:00100000:0.0:1789115310.481067:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789115310.481076:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093bf8d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+6:5831:x1876023308190208:12345-0@lo:501: 00000100:00100000:0.0:1789115310.481306:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093bf8d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+6:5831:x1876023308190208:12345-0@lo:501: Request processed in 231us (533us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789115310.481314:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789115310.481406:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d0d2856 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308190208:0@lo:501: 10000000:01000000:1.0:1789115310.481433:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789115310.481444:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 0000000088d4812d/0xa47abda6516d2e19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115310.481453:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 0000000088d4812d/0xa47abda6516d2e19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115310.481461:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dfcc65aa800 10000000:01000000:1.0:1789115310.481466:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789115310.481470:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dfcc65aa800 10000000:01000000:1.0:1789115310.481473:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789115310.481475:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dfcc65aa800 from 1 10000000:01000000:1.0:1789115310.481483:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789115310.481517:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000007a65b0d7/0xa47abda6516d2e27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115310.481525:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000007a65b0d7/0xa47abda6516d2e27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115310.481532:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000007a65b0d7/0xa47abda6516d2e27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115310.481544:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c991138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308190336:0@lo:101: 00000100:00100000:1.0:1789115310.481570:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115310.481751:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000421a8d85 going to sleep for 11 seconds 00000100:00100000:2.0:1789115310.481832:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308190336 00000100:00100000:2.0:1789115310.481837:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308190336 00000100:00100000:2.0:1789115310.481859:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789115310.481865:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000178adf1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+6:5831:x1876023308190336:12345-0@lo:101: 00010000:00010000:2.0:1789115310.481873:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115310.481884:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000042ac5c25/0xa47abda6516d2e2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2e27 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.481900:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042ac5c25/0xa47abda6516d2e2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2e27 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.481909:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000042ac5c25/0xa47abda6516d2e2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2e27 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.481916:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000042ac5c25, rc 0) 00000100:00100000:2.0:1789115310.481956:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000178adf1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+7:5831:x1876023308190336:12345-0@lo:101: Request processed in 90us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115310.481962:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789115310.482107:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c991138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308190336:0@lo:101: 00010000:00010000:1.0:1789115310.482118:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000007a65b0d7/0xa47abda6516d2e27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115310.482126:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000007a65b0d7/0xa47abda6516d2e27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115310.482139:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789115310.482155:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000007a65b0d7/0xa47abda6516d2e27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115310.482162:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000007a65b0d7/0xa47abda6516d2e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115310.482168:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789115310.482172:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789115310.482176:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dfcc65aa800 10000000:01000000:1.0:1789115310.482185:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789115310.482189:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789115310.482191:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789115310.482206:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000322e51fa/0xa47abda6516d2e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115310.482213:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000322e51fa/0xa47abda6516d2e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115310.482218:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000322e51fa/0xa47abda6516d2e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115310.482229:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c991138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308190464:0@lo:101: 00000100:00100000:1.0:1789115310.482256:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115310.482268:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000421a8d85 going to sleep for 11 seconds 00000100:00100000:2.0:1789115310.482325:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308190464 00000100:00100000:2.0:1789115310.482330:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308190464 00000100:00100000:2.0:1789115310.482348:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789115310.482354:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6351f9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+7:5831:x1876023308190464:12345-0@lo:101: 00010000:00010000:2.0:1789115310.482366:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115310.482372:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000200f36f0/0xa47abda6516d2e3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2e35 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.482412:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000200f36f0/0xa47abda6516d2e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2e35 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.482421:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000200f36f0/0xa47abda6516d2e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2e35 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115310.482427:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000200f36f0, rc 0) 00000100:00100000:2.0:1789115310.482452:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6351f9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+8:5831:x1876023308190464:12345-0@lo:101: Request processed in 99us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115310.482459:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789115310.482535:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c991138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308190464:0@lo:101: 00010000:00010000:1.0:1789115310.482544:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000322e51fa/0xa47abda6516d2e35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e3c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115310.482550:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000322e51fa/0xa47abda6516d2e35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2e3c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115310.482590:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c991138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308190592:0@lo:501: 00000100:00100000:1.0:1789115310.482613:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115310.482638:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000421a8d85 going to sleep for 11 seconds 00000100:00100000:2.0:1789115310.482688:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308190592 00000100:00100000:2.0:1789115310.482692:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308190592 00000100:00100000:2.0:1789115310.482709:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789115310.482714:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f21538e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+8:5831:x1876023308190592:12345-0@lo:501: 00000100:00100000:2.0:1789115310.482910:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f21538e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+9:5831:x1876023308190592:12345-0@lo:501: Request processed in 195us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115310.482917:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789115310.482993:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c991138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308190592:0@lo:501: 00000100:00100000:1.0:1789115310.483022:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c991138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308190720:0@lo:503: 00000100:00100000:1.0:1789115310.483060:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115310.483087:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000421a8d85 going to sleep for 11 seconds 00000100:00100000:2.0:1789115310.483194:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308190720 00000100:00100000:2.0:1789115310.483199:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308190720 00000100:00100000:2.0:1789115310.483215:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789115310.483219:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fd8dceb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+9:5831:x1876023308190720:12345-0@lo:503: 00000100:00100000:2.0:1789115310.483366:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fd8dceb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+9:5831:x1876023308190720:12345-0@lo:503: Request processed in 146us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115310.483373:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789115310.483536:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c991138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308190720:0@lo:503: 00000100:00100000:1.0:1789115310.483912:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c991138 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:5874:1876023308190848:0@lo:502: 00000100:00100000:1.0:1789115310.483952:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115310.483983:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 0000000066d74dd8 going to sleep for 11 seconds 00000100:00100000:2.0:1789115310.484077:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308190848 00000100:00100000:2.0:1789115310.484082:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308190848 00000100:00100000:2.0:1789115310.484114:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789115310.484120:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e43e8f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+9:5874:x1876023308190848:12345-0@lo:502: 00000100:00100000:2.0:1789115310.484267:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e43e8f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+9:5874:x1876023308190848:12345-0@lo:502: Request processed in 147us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115310.484273:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789115310.484410:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c991138 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:5874:1876023308190848:0@lo:502: 00000020:01000000:1.0:1789115310.484434:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115310.484445:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115310.484447:0:5874:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789115310.484452:0:5874:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789115310.484455:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789115310.484469:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000d04a140) 00000020:00000080:1.0:1789115310.484485:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789115310.484490:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789115310.484575:0:5874:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789115310.484583:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa47abda6516d2e4a 00000020:00000080:1.0:1789115310.484799:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789115310.484804:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115310.484808:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115310.484809:0:5874:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789115310.484812:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115310.484815:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115310.484817:0:5874:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789115310.484820:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789115310.484827:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000fd461d50) 00000020:00000080:1.0:1789115310.484836:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789115310.484839:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789115310.484841:0:5874:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789115310.484844:0:5874:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789115310.484850:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789115310.484889:0:5874:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005e959b8f from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789115310.484917:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000053172abc) 00000020:00000080:1.0:1789115310.484926:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789115310.484981:0:5874:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789115310.485302:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa47abda6516d2e5f 00000020:00000080:1.0:1789115310.485437:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789115310.485444:0:5874:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789115310.485449:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa47abda6516d2e66 00080000:01000000:1.0:1789115310.485455:0:5874:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789115310.485458:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa47abda6516d2e6d 00080000:10000000:1.0:1789115310.486206:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1789115310.486583:0:5874:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789115310.490446:0:5874:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789115310.561081:0:5874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789115310.561764:0:5874:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789115310.564140:0:5874:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789115310.564614:0:5874:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789115310.647209:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000db176ff1) 00000020:00000080:0.0:1789115310.647232:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789115310.647333:0:5874:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789115310.647342:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa47abda6516d2e7b 00000020:00000080:0.0:1789115310.648159:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1789115310.649556:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789115310.798351:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00010000:00010000:3.0:1789115310.821171:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1789115310.842930:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789115310.923293:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789115311.003302:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789115311.074062:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1789115311.183761:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa47abda6516d2e82 00000020:00000080:0.0:1789115311.184297:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789115311.184309:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789115311.184315:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115311.184318:0:5874:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789115311.184320:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789115311.184326:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115311.184327:0:5874:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789115311.184332:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789115311.184367:0:5874:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789115311.184419:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789115311.184423:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115311.184425:0:5874:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789115311.184427:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789115311.184430:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115311.184431:0:5874:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789115311.184433:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789115311.184435:0:5874:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789115311.184484:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9dd74f7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:5874:1876023308190976:0@lo:502: 00000100:00100000:0.0:1789115311.184580:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115311.184639:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 00000000821db9b9 going to sleep for 11 seconds 00000100:00100000:2.0:1789115311.184740:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308190976 00000100:00100000:2.0:1789115311.184749:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308190976 00000100:00100000:2.0:1789115311.184801:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789115311.184810:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078ef0314 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+9:5874:x1876023308190976:12345-0@lo:502: 00000100:00100000:2.0:1789115311.185576:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078ef0314 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+9:5874:x1876023308190976:12345-0@lo:502: Request processed in 767us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115311.185588:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789115311.185721:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9dd74f7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:5874:1876023308190976:0@lo:502: 00000020:01000000:1.0:1789115311.185752:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115311.185757:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115311.185759:0:5874:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789115311.185763:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789115311.186287:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789115311.186307:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789115311.186366:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000322e51fa/0xa47abda6516d2e35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e3c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115311.186402:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000322e51fa/0xa47abda6516d2e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e3c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115311.186424:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dfcc65aa800 from 1 10000000:01000000:2.0:1789115311.186428:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789115311.186465:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115311.186473:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115311.186483:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115311.186510:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3163d97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308191104:0@lo:101: 00000100:00100000:2.0:1789115311.186552:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115311.186582:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092e0672a going to sleep for 11 seconds 00000100:00100000:1.0:1789115311.186677:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308191104 00000100:00100000:1.0:1789115311.186684:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308191104 00000100:00100000:1.0:1789115311.186712:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789115311.186718:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d43e985 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+9:5831:x1876023308191104:12345-0@lo:101: 00010000:00010000:1.0:1789115311.186732:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115311.186746:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000064c0cb28/0xa47abda6516d2e90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2e89 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.186770:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000064c0cb28/0xa47abda6516d2e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2e89 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.186781:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000064c0cb28/0xa47abda6516d2e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2e89 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.186801:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000064c0cb28, rc 0) 00000100:00100000:1.0:1789115311.187110:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d43e985 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+10:5831:x1876023308191104:12345-0@lo:101: Request processed in 391us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115311.187117:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789115311.187157:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3163d97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308191104:0@lo:101: 00010000:00010000:1.0:1789115311.187170:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.187179:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2e90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115311.187775:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c991138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308191232:0@lo:256: 00000100:00100000:1.0:1789115311.188156:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115311.188226:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c353913f going to sleep for 11 seconds 00000100:00100000:2.0:1789115311.188319:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308191232 00000100:00100000:2.0:1789115311.188325:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308191232 00000100:00100000:2.0:1789115311.188406:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789115311.188415:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa769339 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+10:5831:x1876023308191232:12345-0@lo:256: 20000000:01000000:2.0:1789115311.188434:0:5843:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789115311.188440:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789115311.188537:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa769339 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+10:5831:x1876023308191232:12345-0@lo:256: Request processed in 123us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115311.188545:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789115311.188614:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c991138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308191232:0@lo:256: 10000000:01000000:3.0:1789115311.189226:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789115311.189251:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115311.189262:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115311.189270:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcc65aa800 from 1 10000000:01000000:3.0:1789115311.189273:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789115311.189307:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115311.189315:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115311.189323:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115311.189340:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005cfb4ac4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308191360:0@lo:101: 00000100:00100000:3.0:1789115311.189425:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115311.189448:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064a22427 going to sleep for 11 seconds 00000100:00100000:0.0:1789115311.189852:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308191360 00000100:00100000:0.0:1789115311.189860:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308191360 00000100:00100000:0.0:1789115311.189895:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789115311.189902:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000faa9eeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+10:5831:x1876023308191360:12345-0@lo:101: 00010000:00010000:0.0:1789115311.189914:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115311.189931:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c24b685/0xa47abda6516d2e9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2e97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115311.189953:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c24b685/0xa47abda6516d2e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2e97 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115311.189976:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c24b685/0xa47abda6516d2e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2e97 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115311.190261:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c24b685, rc 0) 00000100:00100000:0.0:1789115311.190315:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000faa9eeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+11:5831:x1876023308191360:12345-0@lo:101: Request processed in 413us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115311.190321:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789115311.190446:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005cfb4ac4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308191360:0@lo:101: 00010000:00010000:3.0:1789115311.190461:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115311.190470:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2e9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115311.190573:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005cfb4ac4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308191488:0@lo:501: 00000100:00100000:3.0:1789115311.190615:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115311.190690:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064a22427 going to sleep for 11 seconds 00000100:00100000:2.0:1789115311.191095:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308191488 00000100:00100000:2.0:1789115311.191101:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308191488 00000100:00100000:2.0:1789115311.191740:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789115311.191750:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006404ebec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+11:5831:x1876023308191488:12345-0@lo:501: 00000100:00100000:3.0:1789115311.195966:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006404ebec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+11:5831:x1876023308191488:12345-0@lo:501: Request processed in 4212us (5344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115311.195981:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789115311.196098:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005cfb4ac4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308191488:0@lo:501: 00000100:00100000:1.0:1789115311.196178:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000680fed55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308191616:0@lo:503: 00000100:00100000:1.0:1789115311.196230:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115311.196653:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e429d85 going to sleep for 11 seconds 00000100:00100000:3.0:1789115311.200760:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308191616 00000100:00100000:3.0:1789115311.200775:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308191616 00000100:00100000:3.0:1789115311.200834:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789115311.200844:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010f57b5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+11:5831:x1876023308191616:12345-0@lo:503: 00000040:00080000:3.0:1789115311.200919:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789115311.201015:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010f57b5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+11:5831:x1876023308191616:12345-0@lo:503: Request processed in 172us (4785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115311.201024:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789115311.202697:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000680fed55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308191616:0@lo:503: 00000040:00080000:3.0:1789115311.203863:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789115311.204286:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789115311.204307:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789115311.204329:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.204341:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115311.204423:0:5831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789115311.204426:0:5831:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dfcc65aa800 10000000:01000000:1.0:1789115311.204429:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dfcc65aa800 10000000:01000000:1.0:1789115311.204433:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789115311.204439:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dfcc65aa800 from 1 10000000:01000000:1.0:1789115311.204442:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789115311.204481:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000006823b0ab/0xa47abda6516d2ea5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.204488:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000006823b0ab/0xa47abda6516d2ea5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.204497:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000006823b0ab/0xa47abda6516d2ea5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115311.204531:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000680fed55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308191744:0@lo:101: 00000100:00100000:1.0:1789115311.204594:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115311.204640:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072cbb9ff going to sleep for 11 seconds 00000100:00100000:3.0:1789115311.204934:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308191744 00000100:00100000:3.0:1789115311.204941:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308191744 00000100:00100000:3.0:1789115311.204987:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789115311.204994:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e081aae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+11:5831:x1876023308191744:12345-0@lo:101: 00010000:00010000:3.0:1789115311.205007:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115311.205021:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ffe79c22/0xa47abda6516d2eac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2ea5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115311.205043:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ffe79c22/0xa47abda6516d2eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2ea5 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115311.205050:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ffe79c22/0xa47abda6516d2eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2ea5 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115311.205056:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ffe79c22, rc 0) 00000100:00100000:3.0:1789115311.205093:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e081aae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5831:x1876023308191744:12345-0@lo:101: Request processed in 99us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115311.205098:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789115311.205182:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000680fed55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308191744:0@lo:101: 00010000:00010000:1.0:1789115311.205196:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000006823b0ab/0xa47abda6516d2ea5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2eac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.205205:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000006823b0ab/0xa47abda6516d2ea5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2eac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115311.205259:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000680fed55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308191872:0@lo:501: 00000100:00100000:1.0:1789115311.205285:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115311.205317:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072cbb9ff going to sleep for 11 seconds 00000100:00100000:0.0:1789115311.205319:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308191872 00000100:00100000:0.0:1789115311.205329:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308191872 00000100:00100000:0.0:1789115311.205434:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789115311.205441:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3a05823 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5831:x1876023308191872:12345-0@lo:501: 00000100:00100000:0.0:1789115311.205707:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3a05823 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5831:x1876023308191872:12345-0@lo:501: Request processed in 267us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115311.205714:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789115311.205723:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000680fed55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308191872:0@lo:501: 00000100:00100000:1.0:1789115311.205751:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000680fed55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308192000:0@lo:503: 00000100:00100000:1.0:1789115311.205787:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115311.205814:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072cbb9ff going to sleep for 11 seconds 00000100:00100000:3.0:1789115311.205856:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308192000 00000100:00100000:3.0:1789115311.205860:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308192000 00000100:00100000:3.0:1789115311.205887:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789115311.205897:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009286bdcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5831:x1876023308192000:12345-0@lo:503: 00000100:00100000:3.0:1789115311.206132:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009286bdcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5831:x1876023308192000:12345-0@lo:503: Request processed in 236us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115311.206148:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789115311.206155:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000680fed55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308192000:0@lo:503: 00000100:00100000:1.0:1789115311.206706:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000680fed55 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:5879:1876023308192128:0@lo:502: 00000100:00100000:1.0:1789115311.206747:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115311.206778:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ba4e66b going to sleep for 11 seconds 00000100:00100000:0.0:1789115311.206833:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308192128 00000100:00100000:0.0:1789115311.206839:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308192128 00000100:00100000:1.0:1789115311.206888:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789115311.206896:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2ca58e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5879:x1876023308192128:12345-0@lo:502: 00000100:00100000:1.0:1789115311.207532:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2ca58e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5879:x1876023308192128:12345-0@lo:502: Request processed in 636us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115311.207541:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789115311.207662:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000680fed55 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:5879:1876023308192128:0@lo:502: 00000020:01000004:2.0:1789115311.207726:0:5879:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789115311.207742:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b3e4e126) 00000020:00000080:2.0:1789115311.207758:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789115311.207832:0:5879:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005e959b8f from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789115311.207836:0:5879:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005e959b8f from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789115311.207838:0:5879:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005e959b8f 4 00010000:00080000:2.0:1789115311.207868:0:5879:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009da71b73@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1789115311.210683:0:5879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789115311.210860:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789115311.210889:0:5879:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789115311.210897:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa47abda6516d2eba 00000100:00080000:2.0:1789115311.210906:0:5879:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789115311.210910:0:5879:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009da71b73 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1789115311.210945:0:5879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c9ebd276 x1876023308192256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789115311.211070:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9ebd276 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876023308192256:0@lo:38: 00000100:00100000:1.0:1789115311.211143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789115311.211296:0:5879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789115311.211779:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d994575 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:5879:1876023308192384:0@lo:502: 00000100:00100000:1.0:1789115311.211824:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115311.211841:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set 0000000008e90d52 going to sleep for 11 seconds 00000100:00100000:3.0:1789115311.211972:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308192256 00000100:00100000:3.0:1789115311.212097:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308192256 00000100:00100000:3.0:1789115311.212170:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789115311.212180:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c00c745 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876023308192256:12345-0@lo:38: 00000100:00100000:3.0:1789115311.212242:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c00c745 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876023308192256:12345-0@lo:38: Request processed in 62us (1099us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789115311.212250:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789115311.212332:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789115311.212341:0:3304:0:(import.c:65:import_set_state_nolock()) 000000009da71b73 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789115311.212346:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789115311.212349:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9ebd276 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876023308192256:0@lo:38: 00000100:00100000:3.0:1789115311.212376:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308192384 00000100:00100000:3.0:1789115311.212486:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308192384 00000100:00100000:3.0:1789115311.212599:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789115311.212606:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7d6b028 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5879:x1876023308192384:12345-0@lo:502: 00000100:00100000:3.0:1789115311.212829:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7d6b028 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5879:x1876023308192384:12345-0@lo:502: Request processed in 223us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115311.212843:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789115311.212910:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d994575 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:5879:1876023308192384:0@lo:502: 00000040:00080000:2.0:1789115311.212942:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789115311.213016:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789115311.213033:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789115311.213047:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000006823b0ab/0xa47abda6516d2ea5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2eac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115311.213058:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000006823b0ab/0xa47abda6516d2ea5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2eac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789115311.213101:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789115311.213103:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789115311.213108:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115311.213109:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789115311.213110:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115311.213111:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115311.213113:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789115311.213114:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789115311.213115:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789115311.213117:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789115311.213119:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115311.213120:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789115311.213124:0:5831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789115311.213127:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789115311.213128:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789115311.213129:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115311.213130:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789115311.213131:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115311.213132:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115311.213133:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789115311.213134:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789115311.213135:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789115311.213135:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789115311.213136:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115311.213137:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789115311.213153:0:5831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789115311.213163:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001703b8b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308192512:0@lo:253: 00000100:00100000:2.0:1789115311.213206:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115311.213426:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000002dba7948 going to sleep for 11 seconds 00000100:00100000:1.0:1789115311.213588:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308192512 00000100:00100000:1.0:1789115311.213594:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308192512 00000100:00100000:1.0:1789115311.213618:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789115311.213624:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b86cd12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5831:x1876023308192512:12345-0@lo:253: 20000000:01000000:1.0:1789115311.213649:0:5846:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789115311.213661:0:5846:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789115311.260817:0:5846:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789115311.260836:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789115311.260938:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789115311.260944:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789115311.260986:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115311.261009:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000064c0cb28/0xa47abda6516d2e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2e89 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115311.261018:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115311.261092:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000064c0cb28/0xa47abda6516d2e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2e89 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115311.261108:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000064c0cb28/0xa47abda6516d2e90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2e89 expref: 12 pid: 5844 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115311.261124:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a84752c2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1876023308192640:0@lo:104: 00000100:00100000:2.0:1789115311.261198:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115311.261254:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set 000000005eed1b6a going to sleep for 11 seconds 00000100:00100000:1.0:1789115311.261473:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308192640 00000100:00100000:1.0:1789115311.261482:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308192640 00000100:00100000:1.0:1789115311.261541:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789115311.261551:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fdf8794 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+3:5866:x1876023308192640:12345-0@lo:104: 00010000:00010000:1.0:1789115311.261566:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2e90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.261628:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789115311.261633:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fdf8794 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+3:5866:x1876023308192640:12345-0@lo:104: Request processed in 85us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115311.261641:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789115311.261664:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115311.261669:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2e90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.261677:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a858c26a already unused, calling callback (00000000d6a5ba1a) 10000000:00010000:1.0:1789115311.261680:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2e90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.261688:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2e90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115311.261695:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2e90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115311.261700:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789115311.261731:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2e90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.261748:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115311.261768:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2e90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.261774:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000a858c26a/0xa47abda6516d2e89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2e90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.261793:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115311.261794:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115311.261795:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115311.261859:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056ef09f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308192768:0@lo:103: 00000100:00100000:1.0:1789115311.261889:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115311.261954:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308192768 00000100:00100000:1.0:1789115311.261958:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308192768 00010000:00010000:1.0:1789115311.261973:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000064c0cb28/0xa47abda6516d2e90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2e89 expref: 13 pid: 5844 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115311.261995:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789115311.262000:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000508e337c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:3306:x1876023308192768:12345-0@lo:103: 00010000:00010000:1.0:1789115311.262012:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115311.262016:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000064c0cb28/0xa47abda6516d2e90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2e89 expref: 13 pid: 5844 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.262025:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000064c0cb28/0xa47abda6516d2e90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2e89 expref: 13 pid: 5844 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.262054:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.262073:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789115311.262086:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001142988s 00010000:00010000:1.0:1789115311.262089:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.262095:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.262101:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.262106:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.262111:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c9c8537c already unused, calling callback (000000005be2118e) 00010000:00010000:1.0:1789115311.262114:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.262121:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.262127:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.262137:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115311.262166:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000508e337c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:3306:x1876023308192768:12345-0@lo:103: Request processed in 166us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115311.262173:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789115311.262216:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056ef09f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308192768:0@lo:103: 00010000:00010000:1.0:1789115311.262246:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000064c0cb28/0xa47abda6516d2e90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2e89 expref: 12 pid: 5844 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115311.262256:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a84752c2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1876023308192640:0@lo:104: 00010000:00010000:1.0:1789115311.262270:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.262277:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.262282:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115311.262287:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c9c8537c/0xa47abda6516d2ec1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115311.273653:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b86cd12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+11:5831:x1876023308192512:12345-0@lo:253: Request processed in 60020us (60438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115311.273669:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789115311.273763:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001703b8b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:5831:1876023308192512:0@lo:253: 10000000:01000000:0.0:1789115311.273782:0:5831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789115311.273785:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789115311.273787:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789115311.273789:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789115311.273790:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789115311.273791:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789115311.273792:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789115311.273793:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789115311.273795:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789115311.273796:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789115311.273798:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789115311.273800:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789115311.273802:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789115311.273820:0:5831:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789115311.280761:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789115311.281543:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789115311.281774:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789115311.281941:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789115311.282527:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789115311.282715:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789115311.283687:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789115311.283869:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789115311.284286:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789115311.284853:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789115311.285266:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789115311.285721:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1789115311.407058:0:5831:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789115311.457738:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789115311.457918:0:5884:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789115311.457922:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789115311.459733:0:5885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789115311.474945:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789115311.481520:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789115311.481937:0:5831:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789115311.481950:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789115311.483901:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789115311.488396:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789115311.489014:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789115311.489544:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789115311.489828:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789115311.492450:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1789115311.495310:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789115311.495691:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789115311.495846:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789115311.496239:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789115311.496661:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789115311.496841:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789115311.497847:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789115311.498221:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789115311.500841:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789115311.502367:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789115311.502585:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789115311.502740:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789115311.502876:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789115311.503310:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789115311.503771:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789115311.503916:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789115311.504486:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789115311.504656:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789115311.504803:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789115311.504960:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789115311.505767:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789115311.505925:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789115311.508604:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789115311.508789:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789115311.508926:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789115311.509313:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789115311.509606:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789115311.509756:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789115311.509913:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789115311.510618:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789115311.510748:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789115311.510845:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789115311.511673:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789115311.554937:0:5885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789115311.663685:0:5831:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789115311.663722:0:5831:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaea781c6b988 00100000:10000000:3.0:1789115311.663730:0:5831:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789115311.664455:0:5831:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789115311.664472:0:5831:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789115311.664486:0:5831:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789115311.664527:0:5831:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1789115311.679036:0:5885:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789115311.679120:0:5885:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789115311.679125:0:5885:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789115311.845050:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115312.869550:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115313.892195:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115314.917096:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115315.939764:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789115316.387588:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789115316.387597:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789115316.387600:0:36:0:(import.c:65:import_set_state_nolock()) 000000009da71b73 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789115316.387613:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009da71b73 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1789115316.387639:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b0fdbf50 x1876023308193024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789115316.387689:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0fdbf50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876023308193024:0@lo:38: 00000100:00100000:0.0:1789115316.387765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115316.387905:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f372304f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308192896:0@lo:400: 00000100:00100000:1.0:1789115316.387944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115316.388022:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308193024 00000100:00100000:1.0:1789115316.388032:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308193024 00000100:00100000:1.0:1789115316.388067:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789115316.388074:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec0e3340 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1876023308193024:12345-0@lo:38: 00010000:00080000:1.0:1789115316.388104:0:5852:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 133 last 0 00000020:00000080:1.0:1789115316.388145:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa47abda6516d2ec8 00000004:00100000:1.0:1789115316.388212:0:5852:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789115316.388325:0:5852:0:(import.c:65:import_set_state_nolock()) 000000006ae6e073 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789115316.388407:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec0e3340 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876023308193024:12345-0@lo:38: Request processed in 333us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115316.388414:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789115316.388457:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b0fdbf50 x1876023308193024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789115326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789115316.388484:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789115316.388492:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789115316.388496:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789115316.388498:0:3304:0:(import.c:65:import_set_state_nolock()) 000000009da71b73 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789115316.388505:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0fdbf50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876023308193024:0@lo:38: 00000100:00100000:0.0:1789115316.388632:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308192896 00000100:00100000:0.0:1789115316.388638:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308192896 00000100:00100000:0.0:1789115316.388677:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789115316.388683:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000846dd14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+11:3307:x1876023308192896:12345-0@lo:400: 00000100:00100000:0.0:1789115316.388721:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000846dd14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+11:3307:x1876023308192896:12345-0@lo:400: Request processed in 38us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115316.388727:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789115316.388895:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f372304f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308192896:0@lo:400: 00000001:02000400:0.0:1789115316.632754:0:6128:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789115316.964782:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115317.987539:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115319.011626:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789115319.972039:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789115319.972047:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dfcc65aa800 from 3 10000000:01000000:2.0:1789115319.972053:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789115319.972119:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000d67750e1/0xa47abda6516d2ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115319.972132:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000d67750e1/0xa47abda6516d2ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115319.972151:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000d67750e1/0xa47abda6516d2ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115319.972175:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009deeed3b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308193152:0@lo:101: 00000100:00100000:2.0:1789115319.972247:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115319.972302:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c78077c1 going to sleep for 11 seconds 00000100:00100000:0.0:1789115319.972875:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308193152 00000100:00100000:0.0:1789115319.972886:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308193152 00000100:00100000:0.0:1789115319.973051:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789115319.973060:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000772091ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+11:5848:x1876023308193152:12345-0@lo:101: 00010000:00010000:0.0:1789115319.973075:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115319.973089:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c7c354ba/0xa47abda6516d2ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2ecf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115319.973126:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7c354ba/0xa47abda6516d2ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2ecf expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115319.973137:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c7c354ba/0xa47abda6516d2ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2ecf expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115319.973147:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c7c354ba, rc 0) 00000100:00100000:0.0:1789115319.973239:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000772091ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5848:x1876023308193152:12345-0@lo:101: Request processed in 180us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115319.973257:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789115319.978591:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009deeed3b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308193152:0@lo:101: 00010000:00010000:3.0:1789115319.978626:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000d67750e1/0xa47abda6516d2ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2ed6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115319.978647:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000d67750e1/0xa47abda6516d2ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2ed6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115319.978818:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd7af2d2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308193280:0@lo:256: 00000100:00100000:3.0:1789115319.978893:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115319.979005:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308193280 00000100:00100000:3.0:1789115319.979013:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308193280 00000100:00100000:3.0:1789115319.979180:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789115319.979190:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003079c541 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5848:x1876023308193280:12345-0@lo:256: 20000000:01000000:3.0:1789115319.979214:0:5843:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789115319.979228:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789115319.979231:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789115319.979313:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003079c541 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5848:x1876023308193280:12345-0@lo:256: Request processed in 124us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115319.979321:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789115319.979375:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a362af1 going to sleep for 11 seconds 00000100:00100000:3.0:1789115319.979406:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd7af2d2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308193280:0@lo:256: 10000000:01000000:3.0:1789115319.980533:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789115319.980548:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000d67750e1/0xa47abda6516d2ecf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2ed6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115319.980560:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000d67750e1/0xa47abda6516d2ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2ed6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115320.053002:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115321.059559:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115321.508140:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789115321.508168:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f372304f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308193408:0@lo:400: 00000100:00100000:0.0:1789115321.508255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115321.508319:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0fdbf50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308193536:0@lo:400: 00000100:00100000:0.0:1789115321.508350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115321.508408:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308193408 00000100:00100000:0.0:1789115321.508417:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308193408 00000100:00100000:1.0:1789115321.508552:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308193536 00000100:00100000:1.0:1789115321.508557:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308193536 00000100:00100000:1.0:1789115321.508605:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789115321.508616:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9dd74f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308193536:12345-0@lo:400: 00000100:00100000:1.0:1789115321.508679:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9dd74f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308193536:12345-0@lo:400: Request processed in 65us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115321.508686:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789115321.508751:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b0fdbf50 x1876023308193536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115321.508766:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0fdbf50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308193536:0@lo:400: 00000100:00100000:0.0:1789115321.508995:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789115321.509003:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc264808 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+12:3307:x1876023308193408:12345-0@lo:400: 00000100:00100000:0.0:1789115321.509038:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc264808 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+12:3307:x1876023308193408:12345-0@lo:400: Request processed in 37us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115321.509045:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789115321.516659:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f372304f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308193408:0@lo:400: 00010000:00010000:1.0:1789115322.083698:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789115322.535325:0:6329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8c032be0 20000000:00000080:2.0:1789115322.535342:0:6329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dfcfbb11c00 uarg=0000000000000000 20000000:01000000:2.0:1789115322.535374:0:6329:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789115322.535401:0:6329:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789115322.535407:0:6329:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789115322.538456:0:6329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789115322.538473:0:6329:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1789115322.560219:0:6329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789115322.572261:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789115322.572375:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789115322.572479:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789115322.572500:0:6329:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789115322.572524:0:6329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115322.572545:0:6329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003c24b685/0xa47abda6516d2e9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2e97 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115322.572554:0:6329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115322.572604:0:6329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003c24b685/0xa47abda6516d2e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2e97 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115322.572639:0:6329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003c24b685/0xa47abda6516d2e9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2e97 expref: 11 pid: 5846 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115322.572654:0:6329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066205714 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6329:1876023308193664:0@lo:104: 00000100:00100000:0.0:1789115322.572727:0:6329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115322.572790:0:6329:0:(client.c:2715:ptlrpc_set_wait()) set 00000000262ba6a7 going to sleep for 11 seconds 00000100:00100000:2.0:1789115322.572874:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308193664 00000100:00100000:2.0:1789115322.572883:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308193664 00000100:00100000:2.0:1789115322.572936:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789115322.572945:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005661423a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+3:6329:x1876023308193664:12345-0@lo:104: 00010000:00010000:2.0:1789115322.572960:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2e9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115322.573029:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789115322.573035:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005661423a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+3:6329:x1876023308193664:12345-0@lo:104: Request processed in 92us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115322.573042:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789115322.573113:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115322.573119:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2e9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573139:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000db738a23 already unused, calling callback (00000000d6a5ba1a) 10000000:00010000:3.0:1789115322.573142:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2e9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573150:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2e9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115322.573156:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2e9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115322.573162:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789115322.573200:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2e9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573207:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115322.573229:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2e9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573235:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000db738a23/0xa47abda6516d2e97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2e9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573252:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115322.573255:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115322.573256:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115322.573268:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc425d95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308193792:0@lo:103: 00000100:00100000:3.0:1789115322.573301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115322.573344:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308193792 00000100:00100000:3.0:1789115322.573348:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308193792 00010000:00010000:3.0:1789115322.573370:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003c24b685/0xa47abda6516d2e9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2e97 expref: 12 pid: 5846 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115322.573433:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789115322.573441:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa7c1947 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:3306:x1876023308193792:12345-0@lo:103: 00010000:00010000:3.0:1789115322.573452:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115322.573457:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003c24b685/0xa47abda6516d2e9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2e97 expref: 12 pid: 5846 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573467:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003c24b685/0xa47abda6516d2e9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2e97 expref: 12 pid: 5846 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573485:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573492:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573505:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573511:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573518:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573523:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573527:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000044daffd8 already unused, calling callback (000000005be2118e) 00010000:00010000:3.0:1789115322.573531:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573546:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573555:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115322.573564:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115322.573593:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa7c1947 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:3306:x1876023308193792:12345-0@lo:103: Request processed in 153us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115322.573600:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789115322.573635:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc425d95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308193792:0@lo:103: 00010000:00010000:0.0:1789115322.574221:0:6329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003c24b685/0xa47abda6516d2e9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2e97 expref: 11 pid: 5846 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115322.574235:0:6329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066205714 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6329:1876023308193664:0@lo:104: 00010000:00010000:0.0:1789115322.574251:0:6329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115322.574260:0:6329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115322.574265:0:6329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115322.574270:0:6329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000044daffd8/0xa47abda6516d2edd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115323.107614:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115324.131841:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115325.157719:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115326.179723:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789115326.314318:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789115326.314325:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcc65aa800 from 1 10000000:01000000:0.0:1789115326.314330:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789115326.314410:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000003c24b685/0xa47abda6516d2ee4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115326.314424:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000003c24b685/0xa47abda6516d2ee4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115326.314456:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000003c24b685/0xa47abda6516d2ee4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115326.314485:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000157cf661 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308193920:0@lo:101: 00000100:00100000:0.0:1789115326.316049:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115326.316099:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b2beccf going to sleep for 11 seconds 00000100:00100000:3.0:1789115326.316208:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308193920 00000100:00100000:3.0:1789115326.316217:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308193920 00000100:00100000:3.0:1789115326.316310:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789115326.316321:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d882bba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+11:5848:x1876023308193920:12345-0@lo:101: 00010000:00010000:3.0:1789115326.316338:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115326.316358:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ffea412/0xa47abda6516d2eeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2ee4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115326.316416:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ffea412/0xa47abda6516d2eeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2ee4 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115326.316429:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ffea412/0xa47abda6516d2eeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2ee4 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115326.316439:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ffea412, rc 0) 00000100:00100000:3.0:1789115326.316483:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d882bba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5848:x1876023308193920:12345-0@lo:101: Request processed in 164us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115326.316510:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789115326.317123:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000157cf661 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308193920:0@lo:101: 00010000:00010000:0.0:1789115326.317145:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000003c24b685/0xa47abda6516d2ee4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2eeb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115326.317156:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000003c24b685/0xa47abda6516d2ee4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2eeb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115326.317231:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000157cf661 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308194048:0@lo:501: 00000100:00100000:0.0:1789115326.317271:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115326.317305:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b2beccf going to sleep for 11 seconds 00000100:00100000:2.0:1789115326.317359:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308194048 00000100:00100000:2.0:1789115326.317365:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308194048 00000100:00100000:2.0:1789115326.317442:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789115326.317450:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fcbfb8e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5848:x1876023308194048:12345-0@lo:501: 00000100:00100000:2.0:1789115326.317694:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fcbfb8e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5848:x1876023308194048:12345-0@lo:501: Request processed in 244us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115326.317702:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789115326.319034:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000157cf661 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308194048:0@lo:501: 00000100:00100000:1.0:1789115326.319087:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056ef09f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308194176:0@lo:503: 00000100:00100000:1.0:1789115326.319149:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115326.319180:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a5be3ab going to sleep for 11 seconds 00000100:00100000:0.0:1789115326.319535:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308194176 00000100:00100000:0.0:1789115326.319543:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308194176 00000100:00100000:0.0:1789115326.319591:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789115326.319600:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0bdffc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5848:x1876023308194176:12345-0@lo:503: 00000100:00100000:0.0:1789115326.319759:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0bdffc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5848:x1876023308194176:12345-0@lo:503: Request processed in 160us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115326.319766:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789115326.319815:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056ef09f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308194176:0@lo:503: 00000100:00100000:0.0:1789115326.320190:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000050c54574 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:6516:1876023308194304:0@lo:502: 00000100:00100000:0.0:1789115326.320234:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115326.320253:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308194304 00000100:00100000:0.0:1789115326.320257:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308194304 00000100:00100000:0.0:1789115326.320276:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789115326.320281:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086989d8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6516:x1876023308194304:12345-0@lo:502: 00000100:00100000:0.0:1789115326.320423:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086989d8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6516:x1876023308194304:12345-0@lo:502: Request processed in 100us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115326.320431:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789115326.320470:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 000000005a74ffb0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115326.320482:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000050c54574 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:6516:1876023308194304:0@lo:502: 00000020:01000000:0.0:1789115326.321472:0:6516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789115326.321485:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115326.321487:0:6516:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789115326.321496:0:6516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dfcc65aa800 00000020:00000080:0.0:1789115326.321499:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789115326.321741:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:6516:1876023308194432:0@lo:502: 00000100:00100000:0.0:1789115326.321801:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115326.322776:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc734cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789115326.323338:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308194432 00000100:00100000:1.0:1789115326.323349:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308194432 00000100:00100000:1.0:1789115326.323478:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789115326.323490:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6516:x1876023308194432:12345-0@lo:502: 00000100:00100000:1.0:1789115326.327816:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6516:x1876023308194432:12345-0@lo:502: Request processed in 4317us (6004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115326.327845:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789115326.328043:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:6516:1876023308194432:0@lo:502: 00000020:01000000:0.0:1789115326.328085:0:6516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789115326.328095:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115326.328097:0:6516:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789115326.328103:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789115326.328480:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789115326.328501:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789115326.328524:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d2ee4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2eeb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115326.328537:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d2ee4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2eeb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115326.633369:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308194560:0@lo:400: 00000100:00100000:1.0:1789115326.634084:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115326.634448:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308194560 00000100:00100000:2.0:1789115326.634460:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308194560 00000100:00100000:2.0:1789115326.634523:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789115326.634534:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308194560:12345-0@lo:400: 00000100:00100000:2.0:1789115326.634607:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308194560:12345-0@lo:400: Request processed in 74us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115326.634886:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789115326.635710:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dfcdaa73840 x1876023308194560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115326.635728:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308194560:0@lo:400: 00010000:00010000:3.0:1789115327.204497:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115328.227655:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115329.254461:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115330.275526:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789115330.423652:0:6694:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789115330.423656:0:6694:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789115330.423777:0:6694:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dfcd8ba8800 00000020:01000004:2.0:1789115330.423794:0:6694:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789115330.423807:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789115330.423821:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8dfcd8a7ced8) 00000020:00000080:2.0:1789115330.423835:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789115330.450113:0:6694:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789115330.450571:0:6694:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789115330.498624:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789115330.505061:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789115330.505098:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789115330.505158:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789115330.505185:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789115330.505581:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789115330.505593:0:6694:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789115330.505603:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa47abda6516d2ef9 00000020:01000004:3.0:1789115330.505612:0:6694:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789115330.505635:0:6694:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789115330.505639:0:6694:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789115330.505646:0:6694:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789115330.505651:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789115330.505663:0:6694:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8dfcd8a43490) 00000020:00000080:3.0:1789115330.506193:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789115330.510262:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789115330.513265:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789115330.513275:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789115330.516024:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789115330.516038:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789115330.516514:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789115330.516522:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789115330.517975:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789115330.518168:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789115330.518174:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789115330.523199:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789115330.523223:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789115330.572074:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789115330.572365:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789115330.572403:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789115330.581452:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789115330.581469:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789115330.611578:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789115330.611599:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789115330.614571:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789115330.614776:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789115330.614783:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789115330.615967:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789115330.615985:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789115330.698736:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789115330.698984:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789115330.698991:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789115330.701851:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789115330.701868:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789115330.703265:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789115330.703291:0:6694:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789115330.703298:0:6694:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789115330.739603:0:6694:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789115330.739650:0:6694:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789115330.739654:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789115330.739656:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789115330.739658:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115330.739659:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789115330.739660:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115330.739662:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115330.739664:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789115330.739665:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789115330.739667:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789115330.739668:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115330.739670:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789115330.739674:0:6694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789115330.739676:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789115330.739677:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789115330.739679:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115330.739680:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789115330.739681:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115330.739682:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115330.739683:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789115330.739683:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789115330.739684:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789115330.739685:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115330.739686:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789115330.739719:0:6694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789115330.739738:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308194688:0@lo:253: 00000100:00100000:2.0:1789115330.739810:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115330.739925:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd9719e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789115330.741455:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308194688 00000100:00100000:1.0:1789115330.741470:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308194688 00000100:00100000:1.0:1789115330.741541:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789115330.741553:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6694:x1876023308194688:12345-0@lo:253: 20000000:01000000:1.0:1789115330.741592:0:5843:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789115330.741596:0:5843:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789115330.741601:0:5843:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789115330.741605:0:5843:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789115330.742568:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789115330.742798:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789115330.742815:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789115330.742860:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1789115330.742869:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789115330.742899:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1789115330.742948:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1789115330.743305:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789115330.743326:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:1.0:1789115330.743329:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:1.0:1789115330.743360:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789115330.743368:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789115330.743471:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789115330.743481:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:1.0:1789115330.743515:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789115330.743525:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789115330.743557:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789115330.743611:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1789115330.744261:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789115330.744280:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:1.0:1789115330.744282:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:1.0:1789115330.744309:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789115330.744315:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789115330.744341:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789115330.744348:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:1.0:1789115330.754782:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789115330.754814:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789115330.754885:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1789115330.754928:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1789115330.754953:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789115330.754956:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789115330.754963:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789115330.754964:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789115330.754966:0:5843:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789115330.754983:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789115330.754986:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789115330.755029:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789115330.755032:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789115330.756122:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789115330.757908:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789115330.757966:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789115330.758042:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1789115330.758057:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789115330.758060:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789115330.758601:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789115330.758656:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789115330.758724:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789115330.759588:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789115330.759635:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789115330.759700:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789115330.759715:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789115330.759717:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789115330.768931:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1789115330.769044:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1789115330.769095:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789115330.769949:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789115330.769998:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789115330.770037:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:0.0:1789115330.770058:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789115330.770081:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.770101:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2e19 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.770110:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d2e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2e35 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.770116:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfd021c4200/0xa47abda6516d2eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2ea5 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.770124:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.770174:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfd021c4200/0xa47abda6516d2eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2ea5 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.770205:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfd021c4200/0xa47abda6516d2eac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2ea5 expref: 12 pid: 5843 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115330.770221:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaada580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1876023308194816:0@lo:104: 00000100:00100000:0.0:1789115330.770295:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789115330.770415:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d2e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2e35 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.770423:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d2e3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2e35 expref: 12 pid: 5843 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115330.770432:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad8780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1876023308194944:0@lo:104: 00000100:00100000:0.0:1789115330.770455:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789115330.770479:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2e19 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.770488:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2e20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2e19 expref: 12 pid: 5844 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115330.770495:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad8f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1876023308195072:0@lo:104: 00000100:00100000:1.0:1789115330.770502:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308194816 00000100:00100000:1.0:1789115330.770512:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308194816 00000100:00100000:0.0:1789115330.770514:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115330.770524:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd0dca000 going to sleep for 11 seconds 00000100:00100000:1.0:1789115330.770554:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308194944 00000100:00100000:1.0:1789115330.770558:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308194944 00000100:00100000:1.0:1789115330.770571:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308195072 00000100:00100000:1.0:1789115330.770573:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308195072 00000100:00100000:1.0:1789115330.770599:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789115330.770609:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+5:5843:x1876023308194816:12345-0@lo:104: 00010000:00010000:1.0:1789115330.770624:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d2ea5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2eac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115330.770693:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789115330.770700:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+5:5843:x1876023308194816:12345-0@lo:104: Request processed in 92us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115330.770708:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789115330.770727:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789115330.770733:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaadbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+4:5843:x1876023308194944:12345-0@lo:104: 00010000:00010000:1.0:1789115330.770741:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d2e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2e3c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.770756:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115330.770766:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d2ea5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2eac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.770773:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95c200 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115330.770777:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d2ea5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2eac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.770786:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d2ea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2eac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115330.770794:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:3.0:1789115330.770795:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d2ea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2eac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115330.770799:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaadbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+4:5843:x1876023308194944:12345-0@lo:104: Request processed in 67us (345us total) trans 0 rc 0/0 10000000:01000000:3.0:1789115330.770801:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789115330.770805:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789115330.770817:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789115330.770824:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+3:5843:x1876023308195072:12345-0@lo:104: 00010000:00010000:1.0:1789115330.770831:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c000/0xa47abda6516d2e19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2e20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.770833:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d2ea5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2eac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.770839:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115330.770855:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789115330.770859:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+3:5843:x1876023308195072:12345-0@lo:104: Request processed in 37us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115330.770864:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789115330.770868:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d2ea5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2eac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.770875:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d2ea5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2eac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.770887:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789115330.770891:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d2e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2e3c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.770896:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95d000 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115330.770899:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d2e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2e3c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.770905:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d2e35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2e3c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115330.770911:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d2e35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2e3c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115330.770917:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789115330.770930:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d2e35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2e3c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.770936:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789115330.770986:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308195328:0@lo:103: 00000100:00100000:1.0:1789115330.771026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789115330.771077:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d2e35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2e3c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.771084:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d2e35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2e3c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.771094:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115330.771101:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c000/0xa47abda6516d2e19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2e20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.771106:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95c000 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115330.771109:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c000/0xa47abda6516d2e19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2e20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.771116:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c000/0xa47abda6516d2e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2e20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115330.771124:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c000/0xa47abda6516d2e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2e20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115330.771130:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789115330.771144:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c000/0xa47abda6516d2e19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2e20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.771149:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789115330.771213:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaada580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1876023308194816:0@lo:104: 00000100:00100000:0.0:1789115330.771223:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad8780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1876023308194944:0@lo:104: 00000100:00100000:0.0:1789115330.771229:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad8f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1876023308195072:0@lo:104: 00010000:00010000:0.0:1789115330.771258:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115330.771322:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115330.771459:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308195200:0@lo:103: 00000100:00100000:2.0:1789115330.771493:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115330.771644:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308195328 00000100:00100000:0.0:1789115330.771650:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308195328 00010000:00010000:0.0:1789115330.771672:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d2e3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2e35 expref: 13 pid: 5843 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115330.771700:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308195200 00000100:00100000:0.0:1789115330.771703:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308195200 00010000:00010000:0.0:1789115330.771714:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfd021c4200/0xa47abda6516d2eac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2ea5 expref: 14 pid: 5843 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115330.771728:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789115330.771734:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa70f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+14:3305:x1876023308195328:12345-0@lo:103: 00010000:00010000:0.0:1789115330.771746:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115330.771751:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d2e3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2e35 expref: 14 pid: 5843 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.771760:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d2e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2e35 expref: 14 pid: 5843 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.771775:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d2e3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2e35 expref: 14 pid: 5843 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.771788:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115330.771840:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789115330.771847:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789115330.771996:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c000/0xa47abda6516d2e19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2e20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772005:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c000/0xa47abda6516d2e19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2e20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772022:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115330.772024:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115330.772026:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115330.772042:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308195456:0@lo:103: 00000100:00100000:3.0:1789115330.772070:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115330.772332:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308195456 00000100:00100000:3.0:1789115330.772337:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308195456 00010000:00010000:3.0:1789115330.772359:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2e20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2e19 expref: 14 pid: 5844 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115330.772407:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789115330.772427:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789115330.772436:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd3423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+14:3308:x1876023308195200:12345-0@lo:103: 00010000:00010000:3.0:1789115330.772444:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115330.772448:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfd021c4200/0xa47abda6516d2eac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2ea5 expref: 14 pid: 5843 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772458:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfd021c4200/0xa47abda6516d2eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2ea5 expref: 14 pid: 5843 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772469:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfd021c4200/0xa47abda6516d2eac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2ea5 expref: 14 pid: 5843 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772479:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115330.772512:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd3423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:3308:x1876023308195200:12345-0@lo:103: Request processed in 78us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115330.772519:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789115330.772533:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789115330.772539:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789115330.772545:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:3306:x1876023308195456:12345-0@lo:103: 00010000:00010000:3.0:1789115330.772551:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115330.772555:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2e20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2e19 expref: 12 pid: 5844 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772564:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2e19 expref: 12 pid: 5844 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772586:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2e20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2e19 expref: 12 pid: 5844 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772598:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772607:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772620:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772627:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772633:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772640:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772645:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f600 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115330.772649:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772658:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772672:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772690:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115330.772717:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+11:3306:x1876023308195456:12345-0@lo:103: Request processed in 172us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115330.772723:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789115330.772758:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308195200:0@lo:103: 00000100:00100000:3.0:1789115330.772787:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308195456:0@lo:103: 00010000:00010000:3.0:1789115330.772802:0:5843:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772809:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.772815:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28f600/0xa47abda6516d2f07 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789115330.772828:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789115330.775912:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa70f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+10:3305:x1876023308195328:12345-0@lo:103: Request processed in 4166us (4879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115330.775926:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789115330.778411:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308195328:0@lo:103: 00000100:00100000:0.0:1789115330.847947:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+9:6694:x1876023308194688:12345-0@lo:253: Request processed in 106387us (108126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115330.847962:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789115330.847968:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308194688:0@lo:253: 10000000:01000000:2.0:1789115330.847985:0:6694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789115330.847989:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789115330.847991:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789115330.847992:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115330.847993:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789115330.847994:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115330.847995:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115330.847997:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789115330.847999:0:6694:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789115330.848001:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115330.848002:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789115330.848026:0:6694:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dfcd8ba8800 from lustre-OST0000 10000000:01000000:2.0:1789115330.848050:0:6694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789115330.848054:0:6694:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789115330.848061:0:6694:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dfcd92d3490 local copy 10000000:01000000:2.0:1789115330.848066:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789115330.848108:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115330.848120:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115330.848132:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115330.848150:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308195584:0@lo:101: 00000100:00100000:2.0:1789115330.848190:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115330.848304:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd97196c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789115330.855303:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308195584 00000100:00100000:1.0:1789115330.855321:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308195584 00000100:00100000:0.0:1789115330.856024:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789115330.856037:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+9:6694:x1876023308195584:12345-0@lo:101: 00010000:00010000:0.0:1789115330.856063:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115330.856090:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d2f15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2f0e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.856128:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d2f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2f0e expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.856142:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d2f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2f0e expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.856153:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f000, rc 0) 00000100:00100000:0.0:1789115330.856255:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+10:6694:x1876023308195584:12345-0@lo:101: Request processed in 219us (8063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115330.856263:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789115330.857739:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308195584:0@lo:101: 00010000:00010000:3.0:1789115330.857773:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa47abda6516d2f15 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.857787:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa47abda6516d2f15 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115330.857942:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308195712:0@lo:501: 00000100:00100000:3.0:1789115330.858003:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115330.858078:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233480 going to sleep for 11 seconds 00000100:00100000:0.0:1789115330.858521:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308195712 00000100:00100000:0.0:1789115330.858529:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308195712 00000100:00100000:0.0:1789115330.858586:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789115330.858597:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+10:6694:x1876023308195712:12345-0@lo:501: 00000100:00100000:0.0:1789115330.859064:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+10:6694:x1876023308195712:12345-0@lo:501: Request processed in 467us (1059us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789115330.859074:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789115330.859342:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308195712:0@lo:501: 10000000:01000000:3.0:1789115330.859415:0:6694:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789115330.859452:0:6694:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789115330.859470:0:6694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa47abda6516d2f15 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.859483:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa47abda6516d2f15 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.859491:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa47abda6516d2f15 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.859579:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789115330.859600:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dfcd8ba8800 10000000:01000000:3.0:1789115330.859606:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789115330.859611:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8dfcd92d3490 10000000:01000000:3.0:1789115330.859614:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789115330.859618:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dfcd92d3490 from 1 10000000:01000000:3.0:1789115330.859621:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789115330.859671:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4200/0xa47abda6516d2f1c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.859681:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4200/0xa47abda6516d2f1c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.859692:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4200/0xa47abda6516d2f1c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115330.859712:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308195840:0@lo:101: 00000100:00100000:3.0:1789115330.859756:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115330.859865:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233900 going to sleep for 11 seconds 00010000:00010000:2.0:1789115330.864288:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789115330.864303:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa47abda6516d2f15 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115330.864316:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521400 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:2.0:1789115330.864321:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa47abda6516d2f15 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115330.864333:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa47abda6516d2f15 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789115330.864340:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa47abda6516d2f15 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115330.864346:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789115330.865322:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa47abda6516d2f15 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.865334:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115330.865415:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa47abda6516d2f15 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.865425:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2f0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa47abda6516d2f15 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.865447:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115330.865449:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115330.865451:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115330.865460:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789115330.866269:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308195968:0@lo:103: 00000100:00100000:3.0:1789115330.866347:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115330.868225:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308195840 00000100:00100000:1.0:1789115330.868238:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308195840 00000100:00100000:0.0:1789115330.869134:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308195968 00000100:00100000:0.0:1789115330.869143:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308195968 00000100:00100000:0.0:1789115330.869225:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789115330.869236:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+11:3308:x1876023308195968:12345-0@lo:103: 00010000:00010000:0.0:1789115330.869255:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115330.869291:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d2f15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d2f0e expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.869313:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115330.869425:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+10:3308:x1876023308195968:12345-0@lo:103: Request processed in 190us (3077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115330.869433:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789115330.869485:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308195968:0@lo:103: 00000100:00100000:2.0:1789115330.872118:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789115330.872135:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+9:6694:x1876023308195840:12345-0@lo:101: 00010000:00010000:2.0:1789115330.872159:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115330.872185:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc1520600/0xa47abda6516d2f23 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2f1c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115330.872217:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1520600/0xa47abda6516d2f23 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2f1c expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115330.872230:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc1520600/0xa47abda6516d2f23 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2f1c expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115330.872240:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1520600, rc 0) 00000100:00100000:2.0:1789115330.872323:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+10:6694:x1876023308195840:12345-0@lo:101: Request processed in 192us (12566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115330.872344:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789115330.873014:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308195840:0@lo:101: 00010000:00010000:3.0:1789115330.873035:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4200/0xa47abda6516d2f1c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f23 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.873047:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4200/0xa47abda6516d2f1c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2f23 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115330.873069:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789115330.873088:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4200/0xa47abda6516d2f1c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f23 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.873101:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4200/0xa47abda6516d2f1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f23 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115330.873123:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789115330.873129:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789115330.873135:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789115330.873138:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789115330.873171:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.873178:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.873187:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115330.873205:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196096:0@lo:101: 00000100:00100000:3.0:1789115330.873250:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115330.873304:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233900 going to sleep for 11 seconds 00000100:00100000:0.0:1789115330.874830:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308196096 00000100:00100000:0.0:1789115330.874843:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308196096 00000100:00100000:0.0:1789115330.874919:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789115330.874929:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+10:6694:x1876023308196096:12345-0@lo:101: 00010000:00010000:0.0:1789115330.874947:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115330.874967:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d2f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2f2a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.874996:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d2f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2f2a expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.875008:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d2f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2f2a expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115330.875018:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f000, rc 0) 00000100:00100000:0.0:1789115330.875089:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+11:6694:x1876023308196096:12345-0@lo:101: Request processed in 161us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115330.875096:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789115330.875322:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196096:0@lo:101: 00010000:00010000:3.0:1789115330.875341:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f31 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.875351:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2f31 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115330.875615:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196224:0@lo:501: 00000100:00100000:3.0:1789115330.875657:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115330.875732:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233900 going to sleep for 11 seconds 00000100:00100000:0.0:1789115330.875776:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308196224 00000100:00100000:0.0:1789115330.875782:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308196224 00000100:00100000:0.0:1789115330.875863:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789115330.875872:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+11:6694:x1876023308196224:12345-0@lo:501: 00000100:00100000:0.0:1789115330.876144:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+11:6694:x1876023308196224:12345-0@lo:501: Request processed in 273us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115330.876152:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789115330.876223:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196224:0@lo:501: 00000100:00100000:3.0:1789115330.876275:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196352:0@lo:503: 00000100:00100000:3.0:1789115330.876316:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115330.876648:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233900 going to sleep for 11 seconds 00000100:00100000:2.0:1789115330.876698:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308196352 00000100:00100000:2.0:1789115330.876704:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308196352 00000100:00100000:2.0:1789115330.876731:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789115330.876740:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+11:6694:x1876023308196352:12345-0@lo:503: 00000100:00100000:2.0:1789115330.876920:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+11:6694:x1876023308196352:12345-0@lo:503: Request processed in 181us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115330.876928:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789115330.877071:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196352:0@lo:503: 00000040:00080000:3.0:1789115330.877342:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789115330.877464:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196480:0@lo:502: 00000100:00100000:3.0:1789115330.877572:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115330.877594:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233900 going to sleep for 11 seconds 00000100:00100000:0.0:1789115330.877697:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308196480 00000100:00100000:0.0:1789115330.877702:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308196480 00000100:00100000:0.0:1789115330.877779:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789115330.877787:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+11:6694:x1876023308196480:12345-0@lo:502: 00000100:00100000:3.0:1789115330.878585:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196480:0@lo:502: 00000040:00080000:3.0:1789115330.878940:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789115330.878992:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789115330.879028:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789115330.879077:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000100:00100000:0.0:1789115330.879138:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+11:6694:x1876023308196480:12345-0@lo:502: Request processed in 1350us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115330.879148:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000040:00080000:3.0:1789115330.879211:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789115330.879248:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789115330.879582:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196608:0@lo:502: 00000100:00100000:3.0:1789115330.879642:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115330.881313:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233900 going to sleep for 11 seconds 00000100:00100000:0.0:1789115330.881477:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308196608 00000100:00100000:0.0:1789115330.881488:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308196608 00000100:00100000:0.0:1789115330.881555:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789115330.881566:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+11:6694:x1876023308196608:12345-0@lo:502: 00000100:00100000:0.0:1789115330.881814:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+11:6694:x1876023308196608:12345-0@lo:502: Request processed in 249us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115330.881822:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789115330.882010:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196608:0@lo:502: 00000040:00080000:3.0:1789115330.882173:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789115330.882190:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789115330.883095:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789115330.883105:0:6714:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789115330.883111:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115330.883114:0:6714:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789115330.883118:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789115330.883134:0:6714:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8dfcd8a41a48) 00000020:00000080:3.0:1789115330.883160:0:6714:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789115330.883166:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789115330.883241:0:6714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dfcd8ba8800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789115330.883249:0:6714:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789115330.883256:0:6714:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa47abda6516d2f3f 00010000:00010000:3.0:1789115330.894131:0:6714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789115330.899221:0:6714:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789115330.904260:0:6714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789115330.904635:0:6714:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789115330.916705:0:6714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789115330.917731:0:6714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789115330.924019:0:6714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789115330.924034:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115330.924042:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115330.924045:0:6714:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789115330.924049:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789115330.924053:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115330.924055:0:6714:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789115330.924058:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789115330.924060:0:6714:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789115330.924104:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115330.924108:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115330.924109:0:6714:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789115330.924112:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789115330.924320:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789115330.924344:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789115330.924365:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f31 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115330.924415:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f31 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115330.924425:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcd8ba8800 from 1 10000000:01000000:1.0:1789115330.924428:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789115330.924473:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115330.924482:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115330.924506:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115330.924531:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa71a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196736:0@lo:101: 00000100:00100000:1.0:1789115330.924598:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115330.924643:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc7315480 going to sleep for 11 seconds 00000100:00100000:2.0:1789115330.927582:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308196736 00000100:00100000:2.0:1789115330.927599:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308196736 00000100:00100000:2.0:1789115330.927665:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789115330.927676:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+11:6694:x1876023308196736:12345-0@lo:101: 00010000:00010000:2.0:1789115330.927696:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115330.927716:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc1521000/0xa47abda6516d2f4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115330.927757:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1521000/0xa47abda6516d2f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2f46 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115330.927770:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc1521000/0xa47abda6516d2f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2f46 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115330.927781:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1521000, rc 0) 00000100:00100000:2.0:1789115330.927870:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6694:x1876023308196736:12345-0@lo:101: Request processed in 195us (3271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115330.927877:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789115330.928129:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa71a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196736:0@lo:101: 00010000:00010000:1.0:1789115330.928150:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f4d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115330.928161:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2f4d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115330.928282:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa71a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196864:0@lo:501: 00000100:00100000:1.0:1789115330.928323:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115330.928378:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc7315480 going to sleep for 11 seconds 00000100:00100000:2.0:1789115330.929561:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308196864 00000100:00100000:2.0:1789115330.929572:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308196864 00000100:00100000:2.0:1789115330.929617:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789115330.929626:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6694:x1876023308196864:12345-0@lo:501: 00000100:00100000:2.0:1789115330.929921:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6694:x1876023308196864:12345-0@lo:501: Request processed in 295us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115330.929930:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789115330.930178:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa71a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196864:0@lo:501: 00000100:00100000:1.0:1789115330.930230:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa71a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196992:0@lo:503: 00000100:00100000:1.0:1789115330.930278:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115330.930315:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc7315480 going to sleep for 11 seconds 00000100:00100000:0.0:1789115330.930597:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308196992 00000100:00100000:0.0:1789115330.930603:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308196992 00000100:00100000:0.0:1789115330.930630:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789115330.930638:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6694:x1876023308196992:12345-0@lo:503: 00000100:00100000:0.0:1789115330.930839:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6694:x1876023308196992:12345-0@lo:503: Request processed in 201us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115330.930846:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789115330.930907:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa71a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308196992:0@lo:503: 00000040:00080000:0.0:1789115330.931217:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789115330.931294:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308197120:0@lo:502: 00000100:00100000:0.0:1789115330.931336:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115330.931364:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc56740c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115330.931422:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308197120 00000100:00100000:0.0:1789115330.931427:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308197120 00000100:00100000:0.0:1789115330.931449:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789115330.931456:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6694:x1876023308197120:12345-0@lo:502: 00000100:00100000:0.0:1789115330.932107:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6694:x1876023308197120:12345-0@lo:502: Request processed in 647us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115330.932117:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789115330.935828:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308197120:0@lo:502: 00000040:00080000:1.0:1789115330.937096:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789115330.937163:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789115330.937218:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308197248:0@lo:502: 00000100:00100000:1.0:1789115330.937304:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115330.937443:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc7315f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789115330.939684:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308197248 00000100:00100000:3.0:1789115330.939700:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308197248 00000100:00100000:3.0:1789115330.939773:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789115330.939785:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6694:x1876023308197248:12345-0@lo:502: 00000100:00100000:3.0:1789115330.940207:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6694:x1876023308197248:12345-0@lo:502: Request processed in 424us (2902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115330.940216:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789115330.941185:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308197248:0@lo:502: 00000040:00080000:1.0:1789115330.941364:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789115330.941671:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789115330.942288:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789115330.942297:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115330.942299:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789115330.942306:0:6718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dfcd8ba8800 00000020:00000080:3.0:1789115330.942308:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789115330.942327:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789115330.942331:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115330.942332:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789115330.942335:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789115330.944304:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789115330.944343:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789115330.944403:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f4d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115330.944444:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f4d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115330.944652:0:6694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789115330.944656:0:6694:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dfcd8ba8800 10000000:01000000:1.0:1789115330.944660:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dfcd8ba8800 10000000:01000000:1.0:1789115330.944666:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789115330.944673:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dfcd8ba8800 from 1 10000000:01000000:1.0:1789115330.944676:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789115330.944720:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115330.944730:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115330.944742:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115330.944769:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308197376:0@lo:101: 00000100:00100000:1.0:1789115330.944842:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115330.944960:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc73153c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115330.945013:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308197376 00000100:00100000:2.0:1789115330.945022:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308197376 00000100:00100000:2.0:1789115330.945076:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789115330.945086:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6694:x1876023308197376:12345-0@lo:101: 00010000:00010000:2.0:1789115330.945101:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115330.945115:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d2f5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2f54 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115330.945143:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d2f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2f54 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115330.945169:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d2f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2f54 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115330.945179:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1520000, rc 0) 00000100:00100000:2.0:1789115330.945229:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+13:6694:x1876023308197376:12345-0@lo:101: Request processed in 144us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115330.945237:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789115330.945806:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308197376:0@lo:101: 00010000:00010000:3.0:1789115330.945827:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f5b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115330.945865:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2f5b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115330.945986:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308197504:0@lo:501: 00000100:00100000:3.0:1789115330.946029:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115330.946095:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd12339c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115330.946311:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308197504 00000100:00100000:2.0:1789115330.946318:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308197504 00000100:00100000:2.0:1789115330.947035:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789115330.947047:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:6694:x1876023308197504:12345-0@lo:501: 00000100:00100000:2.0:1789115330.947355:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:6694:x1876023308197504:12345-0@lo:501: Request processed in 309us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115330.947364:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789115330.947542:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308197504:0@lo:501: 00000100:00100000:3.0:1789115330.947590:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308197632:0@lo:503: 00000100:00100000:3.0:1789115330.947636:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115330.947662:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd12339c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115330.947874:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308197632 00000100:00100000:0.0:1789115330.947881:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308197632 00000100:00100000:0.0:1789115330.947949:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789115330.947957:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:6694:x1876023308197632:12345-0@lo:503: 00000100:00100000:0.0:1789115330.948117:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:6694:x1876023308197632:12345-0@lo:503: Request processed in 160us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115330.948123:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789115330.948163:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308197632:0@lo:503: 00000040:00080000:0.0:1789115330.948460:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789115330.949934:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308197760:0@lo:502: 00000100:00100000:0.0:1789115330.950012:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115330.950063:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc56740c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115330.950095:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308197760 00000100:00100000:0.0:1789115330.950102:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308197760 00000100:00100000:0.0:1789115330.950140:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789115330.950150:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:6694:x1876023308197760:12345-0@lo:502: 00000100:00100000:0.0:1789115330.950409:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:6694:x1876023308197760:12345-0@lo:502: Request processed in 259us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115330.950424:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789115330.950488:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308197760:0@lo:502: 00000040:00080000:0.0:1789115330.951192:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789115330.951252:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789115330.951285:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789115330.951332:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789115330.953963:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789115330.954135:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789115330.954176:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789115330.954215:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789115330.954265:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789115330.954302:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789115330.954335:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789115330.955052:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789115330.955108:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789115330.955143:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789115330.955194:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789115330.955231:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789115330.955264:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789115330.955314:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789115330.955422:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789115330.955461:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789115330.957331:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789115330.957445:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789115330.957485:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789115330.957548:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789115330.957585:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789115330.957616:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789115330.957666:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789115330.957699:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1789115330.957759:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308197888:0@lo:502: 00000100:00100000:0.0:1789115330.958039:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115330.958100:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd88c0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789115330.958214:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308197888 00000100:00100000:1.0:1789115330.958225:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308197888 00000100:00100000:1.0:1789115330.958290:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789115330.958302:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:6694:x1876023308197888:12345-0@lo:502: 00000100:00100000:1.0:1789115330.958576:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:6694:x1876023308197888:12345-0@lo:502: Request processed in 275us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115330.958584:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789115330.958831:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308197888:0@lo:502: 00000040:00080000:0.0:1789115330.959001:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789115330.959015:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789115330.959722:0:6719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789115330.959737:0:6719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8dfcfcfc9a48) 00000020:00000080:0.0:1789115330.959757:0:6719:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789115330.959927:0:6719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dfcd8ba8800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789115330.959934:0:6719:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dfcd8ba8800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789115330.959937:0:6719:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dfcd8ba8800 3 00010000:00080000:0.0:1789115330.959969:0:6719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dfcffd09800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1789115330.963257:0:6719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1789115330.963527:0:6719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789115330.963569:0:6719:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789115330.963582:0:6719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa47abda6516d2f69 00000100:00080000:0.0:1789115330.963593:0:6719:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789115330.963599:0:6719:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dfcffd09800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1789115330.963645:0:6719:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfcdaad8780 x1876023308198016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789115330.963668:0:6719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789115330.963748:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308198144:0@lo:400: 00000100:00100000:0.0:1789115330.963862:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115330.963946:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308198144 00000100:00100000:0.0:1789115330.963955:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308198144 00000100:00100000:0.0:1789115330.964000:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789115330.964010:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308198144:12345-0@lo:400: 00000100:00100000:0.0:1789115330.964080:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308198144:12345-0@lo:400: Request processed in 71us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115330.964088:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789115330.964131:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dfcdaada580 x1876023308198144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115330.964144:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308198144:0@lo:400: 00000100:00100000:1.0:1789115330.964378:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876023308198016:0@lo:38: 00000100:00100000:1.0:1789115330.964431:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115330.964469:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308198016 00000100:00100000:1.0:1789115330.964473:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308198016 00000100:00100000:1.0:1789115330.964495:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789115330.964500:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876023308198016:12345-0@lo:38: 00010000:00080000:1.0:1789115330.964523:0:5850:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:1.0:1789115330.964558:0:5850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa47abda6516d2f70 00000004:00100000:1.0:1789115330.964577:0:5850:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789115330.964611:0:5850:0:(import.c:65:import_set_state_nolock()) ffff8dfcf5317800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789115330.964657:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876023308198016:12345-0@lo:38: Request processed in 156us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115330.964664:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789115330.964694:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dfcdaad8780 x1876023308198016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789115340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115330.964703:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789115330.964709:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789115330.964717:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789115330.964722:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789115330.964724:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcffd09800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789115330.964730:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876023308198016:0@lo:38: 00000040:00080000:1.0:1789115330.969673:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1789115330.969725:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789115330.969748:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789115330.969765:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f5b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115330.969793:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f5b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789115330.969991:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789115330.969995:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789115330.969997:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789115330.969998:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789115330.970000:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789115330.970002:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789115330.970003:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789115330.970006:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789115330.970007:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789115330.970010:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789115330.970011:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789115330.970016:0:6694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789115330.970019:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789115330.970021:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789115330.970023:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789115330.970024:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789115330.970025:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789115330.970027:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789115330.970028:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789115330.970029:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789115330.970031:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789115330.970031:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789115330.970032:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789115330.970066:0:6694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789115330.970086:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308198272:0@lo:253: 00000100:00100000:1.0:1789115330.970160:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115330.970197:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc7315f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115330.970969:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308198272 00000100:00100000:0.0:1789115330.970980:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308198272 00000100:00100000:0.0:1789115330.971032:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789115330.971043:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+13:6694:x1876023308198272:12345-0@lo:253: 20000000:01000000:0.0:1789115330.971079:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789115330.971092:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789115331.037555:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789115331.037576:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789115331.037873:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789115331.037880:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789115331.037906:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115331.037929:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfccf28e000/0xa47abda6516d2ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2ecf expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115331.037939:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115331.037991:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfccf28e000/0xa47abda6516d2ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2ecf expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115331.038007:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfccf28e000/0xa47abda6516d2ed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2ecf expref: 13 pid: 5846 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115331.038042:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd34212c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1876023308198400:0@lo:104: 00000100:00100000:2.0:1789115331.038119:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115331.038191:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd9719c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789115331.038335:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308198400 00000100:00100000:1.0:1789115331.038345:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308198400 00000100:00100000:1.0:1789115331.038438:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789115331.038459:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd3423840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+3:5866:x1876023308198400:12345-0@lo:104: 00010000:00010000:1.0:1789115331.038488:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520c00/0xa47abda6516d2ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2ed6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.038554:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789115331.038561:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd3423840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+3:5866:x1876023308198400:12345-0@lo:104: Request processed in 106us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115331.038571:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789115331.038612:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd34212c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1876023308198400:0@lo:104: 00010000:00010000:1.0:1789115331.038634:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.038667:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115331.038675:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520c00/0xa47abda6516d2ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2ed6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.038683:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1520c00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:1.0:1789115331.038688:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520c00/0xa47abda6516d2ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2ed6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.038943:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520c00/0xa47abda6516d2ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2ed6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115331.038955:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520c00/0xa47abda6516d2ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2ed6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115331.038963:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789115331.039005:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520c00/0xa47abda6516d2ecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2ed6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.039024:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115331.039046:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520c00/0xa47abda6516d2ecf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2ed6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.039054:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520c00/0xa47abda6516d2ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2ed6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.039075:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115331.039077:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115331.039079:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115331.039104:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308198528:0@lo:103: 00000100:00100000:1.0:1789115331.039148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115331.039198:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308198528 00000100:00100000:1.0:1789115331.039204:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308198528 00010000:00010000:1.0:1789115331.039225:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfccf28e000/0xa47abda6516d2ed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2ecf expref: 14 pid: 5846 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115331.039251:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789115331.039260:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+14:3305:x1876023308198528:12345-0@lo:103: 00010000:00010000:1.0:1789115331.039274:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115331.039280:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfccf28e000/0xa47abda6516d2ed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2ecf expref: 14 pid: 5846 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.039292:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfccf28e000/0xa47abda6516d2ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2ecf expref: 14 pid: 5846 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.039308:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28e000/0xa47abda6516d2ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2ecf expref: 14 pid: 5846 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.039335:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.039345:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789115331.039360:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001482325s 00010000:00010000:1.0:1789115331.039366:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.039422:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.039431:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.039438:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.039445:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521a00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115331.039449:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.039458:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115331.056232:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115331.056252:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.061940:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.061962:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2f77 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115331.062000:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115331.062213:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:3305:x1876023308198528:12345-0@lo:103: Request processed in 22949us (23059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115331.062225:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789115331.062360:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308198528:0@lo:103: 00000100:00100000:1.0:1789115331.062484:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+12:6694:x1876023308198272:12345-0@lo:253: Request processed in 91442us (92323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115331.062504:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789115331.065297:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:6694:1876023308198272:0@lo:253: 10000000:01000000:2.0:1789115331.065319:0:6694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789115331.065323:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789115331.065324:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789115331.065326:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115331.065327:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789115331.065329:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115331.065331:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115331.065332:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789115331.065334:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789115331.065336:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789115331.065338:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115331.065340:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789115331.065356:0:6694:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789115331.081994:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789115331.082227:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789115331.082933:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789115331.083125:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789115331.083648:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:0.0:1789115331.084073:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789115331.085696:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1789115331.319149:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789115331.488906:0:6694:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789115331.488915:0:6694:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789115331.489038:0:6694:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789115331.489097:0:6694:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789115331.489110:0:6694:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789115331.489127:0:6694:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789115332.323593:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115333.347487:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789115334.308214:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789115334.308223:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dfcc65aa800 from 21 10000000:01000000:3.0:1789115334.308230:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789115334.308286:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115334.308300:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115334.308314:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115334.308360:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308198656:0@lo:101: 00000100:00100000:3.0:1789115334.308477:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115334.308524:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8427300 going to sleep for 11 seconds 00000100:00100000:3.0:1789115334.308548:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308198656 00000100:00100000:3.0:1789115334.308556:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308198656 00000100:00100000:3.0:1789115334.308609:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789115334.308620:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5848:x1876023308198656:12345-0@lo:101: 00010000:00010000:3.0:1789115334.308637:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115334.308651:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfd021c5000/0xa47abda6516d2f85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2f7e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115334.308682:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfd021c5000/0xa47abda6516d2f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2f7e expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115334.308694:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfd021c5000/0xa47abda6516d2f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2f7e expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115334.308704:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c5000, rc 0) 00000100:00100000:3.0:1789115334.308742:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:5848:x1876023308198656:12345-0@lo:101: Request processed in 123us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115334.308749:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789115334.309058:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308198656:0@lo:101: 00010000:00010000:3.0:1789115334.309077:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f85 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115334.309088:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2f85 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115334.309243:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308198784:0@lo:501: 00000100:00100000:3.0:1789115334.309275:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115334.309362:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8427300 going to sleep for 11 seconds 00000100:00100000:1.0:1789115334.309678:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308198784 00000100:00100000:1.0:1789115334.309685:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308198784 00000100:00100000:1.0:1789115334.309750:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789115334.309760:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+13:5848:x1876023308198784:12345-0@lo:501: 00000100:00100000:1.0:1789115334.310134:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+13:5848:x1876023308198784:12345-0@lo:501: Request processed in 360us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115334.310144:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789115334.310216:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308198784:0@lo:501: 00000100:00100000:0.0:1789115334.310263:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaada1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308198912:0@lo:503: 00000100:00100000:0.0:1789115334.310312:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115334.310548:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233840 going to sleep for 11 seconds 00000100:00100000:3.0:1789115334.311313:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308198912 00000100:00100000:3.0:1789115334.311322:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308198912 00000100:00100000:3.0:1789115334.311513:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789115334.311527:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:5848:x1876023308198912:12345-0@lo:503: 00000100:00100000:3.0:1789115334.311751:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:5848:x1876023308198912:12345-0@lo:503: Request processed in 228us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115334.311760:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789115334.314404:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaada1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308198912:0@lo:503: 00000100:00100000:0.0:1789115334.317579:0:6874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaada1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:6874:1876023308199040:0@lo:502: 00000100:00100000:0.0:1789115334.317676:0:6874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115334.317735:0:6874:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd12336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789115334.317845:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308199040 00000100:00100000:3.0:1789115334.317854:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308199040 00000100:00100000:3.0:1789115334.317910:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789115334.317920:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:6874:x1876023308199040:12345-0@lo:502: 00000100:00100000:3.0:1789115334.318160:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:6874:x1876023308199040:12345-0@lo:502: Request processed in 237us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115334.318169:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789115334.318289:0:6874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaada1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:6874:1876023308199040:0@lo:502: 00000100:00100000:0.0:1789115334.318340:0:6874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaada1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:6874:1876023308199168:0@lo:502: 00000100:00100000:0.0:1789115334.318460:0:6874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115334.318524:0:6874:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd12336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789115334.318552:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308199168 00000100:00100000:3.0:1789115334.318557:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308199168 00000100:00100000:3.0:1789115334.318610:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789115334.318618:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:6874:x1876023308199168:12345-0@lo:502: 00000100:00100000:3.0:1789115334.318749:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:6874:x1876023308199168:12345-0@lo:502: Request processed in 132us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115334.318755:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789115334.318988:0:6874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaada1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:6874:1876023308199168:0@lo:502: 00000040:00080000:1.0:1789115334.319021:0:6874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789115334.319111:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789115334.319133:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789115334.319145:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f85 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115334.319157:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f85 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789115334.319168:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789115334.319172:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dfcc65aa800 from 4 10000000:01000000:0.0:1789115334.319175:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789115334.319207:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115334.319216:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115334.319227:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115334.319247:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaada940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308199296:0@lo:101: 00000100:00100000:0.0:1789115334.319278:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115334.319299:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233240 going to sleep for 11 seconds 00000100:00100000:1.0:1789115334.319323:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308199296 00000100:00100000:1.0:1789115334.319329:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308199296 00000100:00100000:1.0:1789115334.319372:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789115334.319557:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+13:5848:x1876023308199296:12345-0@lo:101: 00010000:00010000:1.0:1789115334.319571:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115334.319589:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d2f93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2f8c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115334.319615:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d2f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2f8c expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115334.319627:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d2f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2f8c expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115334.319649:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcda95d400, rc 0) 00000100:00100000:1.0:1789115334.319693:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308199296:12345-0@lo:101: Request processed in 312us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115334.319701:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789115334.319723:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaada940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308199296:0@lo:101: 00010000:00010000:0.0:1789115334.319737:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f93 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115334.319748:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2f93 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115334.319793:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaada940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308199424:0@lo:256: 00000100:00100000:0.0:1789115334.319824:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115334.319853:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233240 going to sleep for 11 seconds 00000100:00100000:3.0:1789115334.319889:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308199424 00000100:00100000:3.0:1789115334.319899:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308199424 00000100:00100000:3.0:1789115334.319958:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789115334.319967:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308199424:12345-0@lo:256: 20000000:01000000:3.0:1789115334.319981:0:5843:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789115334.319997:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789115334.320001:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789115334.320089:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308199424:12345-0@lo:256: Request processed in 124us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115334.320096:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789115334.320269:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaada940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308199424:0@lo:256: 10000000:01000000:1.0:1789115334.320326:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789115334.320334:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f93 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115334.320343:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2f93 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115334.320361:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789115334.320363:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789115334.320365:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789115334.320407:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115334.320415:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115334.320424:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115334.320439:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308199552:0@lo:101: 00000100:00100000:1.0:1789115334.320468:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115334.320588:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc7315300 going to sleep for 11 seconds 00000100:00100000:0.0:1789115334.320683:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308199552 00000100:00100000:0.0:1789115334.320688:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308199552 00000100:00100000:0.0:1789115334.320710:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789115334.320717:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308199552:12345-0@lo:101: 00010000:00010000:0.0:1789115334.320726:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115334.320738:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d2fa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2f9a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115334.320756:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d2fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2f9a expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115334.320766:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d2fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2f9a expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115334.320785:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e600, rc 0) 00000100:00100000:0.0:1789115334.320818:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308199552:12345-0@lo:101: Request processed in 101us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115334.320825:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789115334.320858:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308199552:0@lo:101: 00010000:00010000:0.0:1789115334.320869:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2fa1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115334.320877:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2fa1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115334.320921:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308199680:0@lo:501: 00000100:00100000:0.0:1789115334.320944:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115334.320957:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233240 going to sleep for 11 seconds 00000100:00100000:0.0:1789115334.320967:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308199680 00000100:00100000:0.0:1789115334.320970:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308199680 00000100:00100000:0.0:1789115334.320985:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789115334.320990:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308199680:12345-0@lo:501: 00000100:00100000:0.0:1789115334.321236:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308199680:12345-0@lo:501: Request processed in 244us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115334.321245:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789115334.321281:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308199680:0@lo:501: 00000100:00100000:0.0:1789115334.321509:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308199808:0@lo:503: 00000100:00100000:0.0:1789115334.321551:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115334.321616:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233240 going to sleep for 11 seconds 00000100:00100000:1.0:1789115334.321655:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308199808 00000100:00100000:1.0:1789115334.321659:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308199808 00000100:00100000:1.0:1789115334.321722:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789115334.321733:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308199808:12345-0@lo:503: 00000100:00100000:1.0:1789115334.321972:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308199808:12345-0@lo:503: Request processed in 241us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115334.321980:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789115334.322047:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308199808:0@lo:503: 00000100:00100000:0.0:1789115334.322234:0:6875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:6875:1876023308199936:0@lo:502: 00000100:00100000:0.0:1789115334.322271:0:6875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115334.322996:0:6875:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd12336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789115334.323040:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308199936 00000100:00100000:3.0:1789115334.323048:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308199936 00000100:00100000:3.0:1789115334.323085:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789115334.323094:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+15:6875:x1876023308199936:12345-0@lo:502: 00000100:00100000:3.0:1789115334.323567:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+15:6875:x1876023308199936:12345-0@lo:502: Request processed in 473us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115334.323575:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789115334.323680:0:6875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:6875:1876023308199936:0@lo:502: 00000020:01000000:0.0:1789115334.323711:0:6875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789115334.323717:0:6875:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789115334.323724:0:6875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115334.323727:0:6875:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789115334.323736:0:6875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789115334.323740:0:6875:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:0.0:1789115334.323760:0:6875:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789115334.323762:0:6875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789115334.323776:0:6875:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dfcfcfc8000) 00000020:00000080:0.0:1789115334.323794:0:6875:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789115334.323799:0:6875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789115334.323950:0:6875:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789115334.323956:0:6875:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789115334.323964:0:6875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa47abda6516d2faf 00010000:00080000:0.0:1789115334.323994:0:6875:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dfcd933a800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1789115334.324217:0:6875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789115334.357305:0:6875:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789115334.357328:0:6875:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789115334.358242:0:6875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789115334.358614:0:6875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789115334.358680:0:6875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789115334.358756:0:6875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789115334.359813:0:6880:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789115334.359819:0:6880:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789115334.360452:0:6875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789115334.360466:0:6875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789115334.360499:0:6875:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789115334.360523:0:6875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa47abda6516d2fb6 00000100:00080000:2.0:1789115334.360536:0:6875:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789115334.360544:0:6875:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dfcd933a800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1789115334.360590:0:6875:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfcd3421e00 x1876023308200064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789115334.360629:0:6875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789115334.360701:0:6875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115334.360706:0:6875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115334.360708:0:6875:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789115334.360711:0:6875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789115334.360716:0:6875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115334.360718:0:6875:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000100:00100000:3.0:1789115334.360759:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308200192:0@lo:400: 00000100:00100000:0.0:1789115334.360774:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3421e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308200064:0@lo:8: 00000020:00000080:2.0:1789115334.360906:0:6875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789115334.360910:0:6875:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789115334.360942:0:6875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3421a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:6875:1876023308200448:0@lo:502: 00000100:00100000:3.0:1789115334.361017:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115334.361018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115334.361105:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308200320:0@lo:400: 00000100:00100000:0.0:1789115334.361136:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115334.361177:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308200192 00000100:00100000:0.0:1789115334.361184:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308200192 00000100:00100000:2.0:1789115334.361196:0:6875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115334.361222:0:6875:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd9705e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789115334.361228:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308200320 00000100:00100000:0.0:1789115334.361233:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308200320 00000100:00080000:2.0:1789115334.361257:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115334.361264:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789115334.361274:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308200192:12345-0@lo:400: 00000100:00100000:3.0:1789115334.361318:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308200448 00000100:00100000:3.0:1789115334.361323:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308200448 00000100:00100000:3.0:1789115334.361372:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789115334.361793:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+15:6875:x1876023308200448:12345-0@lo:502: 00000100:00100000:3.0:1789115334.362058:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+15:6875:x1876023308200448:12345-0@lo:502: Request processed in 678us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115334.362066:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789115334.362239:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308200192:12345-0@lo:400: Request processed in 965us (1225us total) trans 0 rc 0/0 00010000:00080000:2.0:1789115334.362246:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd35f4000 x1876023308200192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115334.362247:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789115334.362262:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308200192:0@lo:400: 00000100:00100000:0.0:1789115334.362267:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789115334.362276:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaadad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308200320:12345-0@lo:400: 00000100:00100000:2.0:1789115334.362303:0:6875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3421a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:6875:1876023308200448:0@lo:502: 00000020:01000000:2.0:1789115334.362338:0:6875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1789115334.362339:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaadad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308200320:12345-0@lo:400: Request processed in 64us (1200us total) trans 0 rc 0/0 00000020:00000080:2.0:1789115334.362358:0:6875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1789115334.362359:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:00000080:2.0:1789115334.362360:0:6875:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789115334.362365:0:6875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1789115334.362413:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308200064 00000100:00100000:0.0:1789115334.362419:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308200064 00000020:01000000:2.0:1789115334.362490:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00100000:0.0:1789115334.362500:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789115334.362505:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1876023308200064:12345-0@lo:8: 10000000:01000000:2.0:1789115334.362512:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789115334.362523:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2fa1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1789115334.362527:0:6697:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00010000:00010000:2.0:1789115334.362534:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2fa1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115334.362556:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 00000020:00000080:0.0:1789115334.362556:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa47abda6516d2fbd 10000000:01000000:2.0:1789115334.362560:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dfcd92d3490 from 1 10000000:01000000:2.0:1789115334.362563:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00002000:00100000:0.0:1789115334.362594:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dfcd9338000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398e ocd_grant: 0 ocd_index: 0 ocd_group 0 00010000:00010000:2.0:1789115334.362596:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789115334.362599:0:6697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00010000:00010000:2.0:1789115334.362604:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1789115334.362604:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1789115334.362613:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115334.362630:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3421a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308200576:0@lo:101: 00000100:00100000:2.0:1789115334.362666:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115334.362699:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfcfae9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115334.362716:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308200576 00000100:00100000:2.0:1789115334.362719:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308200576 00002000:00100000:0.0:1789115334.362728:0:6697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789115334.362748:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789115334.362756:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308200576:12345-0@lo:101: 00010000:00010000:2.0:1789115334.362765:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115334.362779:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2fcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2fc4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115334.362965:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2fc4 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115334.363656:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2fc4 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115334.363683:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1521a00, rc 0) 00000100:00100000:2.0:1789115334.363741:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308200576:12345-0@lo:101: Request processed in 985us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115334.363749:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00002000:00080000:0.0:1789115334.364002:0:6697:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789115334.364109:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8dfcd933f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789115334.364168:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876023308200064:12345-0@lo:8: Request processed in 1660us (3153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115334.364175:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789115334.364222:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd35f6940 x1876023308200320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115334.364238:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308200320:0@lo:400: 00010000:00080000:1.0:1789115334.364266:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd3421e00 x1876023308200064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789115344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115334.364278:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789115334.364286:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789115334.364295:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789115334.364301:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789115334.364304:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcd933a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789115334.364328:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3421a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308200576:0@lo:101: 00000004:00080000:1.0:1789115334.364330:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789115334.364340:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3421e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308200064:0@lo:8: 00010000:00010000:3.0:1789115334.364367:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2fcb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115334.364408:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2fcb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115334.364483:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308200704:0@lo:501: 00000100:00100000:3.0:1789115334.364523:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115334.364556:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc6728240 going to sleep for 11 seconds 00000004:00080000:3.0:1789115334.364573:0:6880:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789115334.364718:0:6880:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 151577335253ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789115334.364762:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308200704 00000100:00100000:2.0:1789115334.364769:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308200704 00000100:00100000:2.0:1789115334.364800:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789115334.365122:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308200704:12345-0@lo:501: 00000100:00100000:2.0:1789115334.365360:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308200704:12345-0@lo:501: Request processed in 227us (822us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789115334.367565:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789115334.367659:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308200704:0@lo:501: 10000000:01000000:2.0:1789115334.367705:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789115334.367719:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2fcb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115334.367733:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2fcb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115334.375546:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789115334.413180:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789115334.426222:0:6881:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789115334.426223:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789115334.426247:0:6881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa73c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1876023308200960:0@lo:7: 00000100:00100000:0.0:1789115334.426247:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308200832:0@lo:13: 00000100:00100000:1.0:1789115334.426325:0:6881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115334.426487:0:6881:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc7315f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115334.426564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115334.426638:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308200832 00000100:00100000:2.0:1789115334.426647:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308200832 00000100:00100000:2.0:1789115334.426743:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789115334.426755:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876023308200832:12345-0@lo:13: 00000100:00100000:3.0:1789115334.426761:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308200960 00000100:00100000:3.0:1789115334.426767:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308200960 00002000:00000024:2.0:1789115334.426795:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789115334.426807:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789115334.426816:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6881:x1876023308200960:12345-0@lo:7: 00000100:00100000:1.0:1789115334.426820:0:6698:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789115334.426829:0:6698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789115334.426966:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876023308200832:12345-0@lo:13: Request processed in 213us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115334.426975:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789115334.427006:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcdaa70000 x1876023308200832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115334.427028:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308200832:0@lo:13: 00000100:00080000:0.0:1789115334.427083:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1789115334.431737:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789115334.431747:0:6699:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789115334.431928:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6881:x1876023308200960:12345-0@lo:7: Request processed in 5108us (5597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115334.431944:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789115334.432056:0:6881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcdaa73c00 x1876023308200960/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789115350 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115334.432089:0:6881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa73c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1876023308200960:0@lo:7: 00000004:00080000:1.0:1789115334.432106:0:6881:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789115334.432155:0:6881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa73c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1876023308201088:0@lo:5: 00000100:00100000:1.0:1789115334.432195:0:6881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115334.432248:0:6881:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc7315f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115334.432297:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308201088 00000100:00100000:0.0:1789115334.432305:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308201088 00000100:00100000:0.0:1789115334.432369:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789115334.432405:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6881:x1876023308201088:12345-0@lo:5: 00002000:00080000:0.0:1789115334.432442:0:6697:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789115334.432447:0:6697:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789115334.432726:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6881:x1876023308201088:12345-0@lo:5: Request processed in 347us (528us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789115334.432733:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789115334.432847:0:6881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcdaa73c00 x1876023308201088/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789115350 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115334.432862:0:6881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa73c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1876023308201088:0@lo:5: 00000004:00080000:2.0:1789115334.432871:0:6881:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789115334.432898:0:6881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1876023308201216:0@lo:700: 00000100:00100000:2.0:1789115334.433000:0:6881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115334.433028:0:6881:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfcfaecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789115334.433152:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308201216 00000100:00100000:3.0:1789115334.433158:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308201216 00000100:00100000:3.0:1789115334.433473:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789115334.433483:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd34221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6881:x1876023308201216:12345-0@lo:700: 00000100:00100000:3.0:1789115334.433517:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6705:1876023308201344:0@lo:700: 00000100:00100000:3.0:1789115334.433552:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115334.433574:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc6728b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789115334.433742:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308201344 00000100:00100000:0.0:1789115334.433747:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308201344 00000100:00100000:0.0:1789115334.433779:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789115334.433786:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6705:x1876023308201344:12345-0@lo:700: 40000000:02000000:3.0:1789115334.449587:0:5857:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1789115334.455288:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6705:x1876023308201344:12345-0@lo:700: Request processed in 21494us (21726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115334.455559:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789115334.455569:0:6705:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd35f7480 x1876023308201344/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789115350 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115334.455587:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6705:1876023308201344:0@lo:700: 40000000:02000000:3.0:1789115334.455617:0:6705:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1789115334.498279:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789115334.498299:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789115334.498488:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd34221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6881:x1876023308201216:12345-0@lo:700: Request processed in 65001us (65482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115334.498505:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789115334.498605:0:6881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd3420780 x1876023308201216/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789115350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115334.498619:0:6881:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789115334.498636:0:6881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1876023308201216:0@lo:700: 00000004:02000040:1.0:1789115334.520236:0:6881:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1789115334.524824:0:6881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1876023308201472:0@lo:5: 00000100:00100000:2.0:1789115334.525026:0:6881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115334.525191:0:6881:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8980840 going to sleep for 11 seconds 00000100:00100000:1.0:1789115334.525301:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308201472 00000100:00100000:1.0:1789115334.525310:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308201472 00000100:00100000:1.0:1789115334.525451:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789115334.525463:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd3421a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:6881:x1876023308201472:12345-0@lo:5: 00002000:00080000:0.0:1789115334.531784:0:6885:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789115334.531813:0:6885:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789115334.536296:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd3421a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:6881:x1876023308201472:12345-0@lo:5: Request processed in 10827us (11262us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789115334.536311:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789115334.536410:0:6881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd3420780 x1876023308201472/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789115350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115334.536431:0:6881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1876023308201472:0@lo:5: 00000004:00080000:2.0:1789115334.536449:0:6881:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789115335.398649:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115336.419800:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115337.443487:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789115338.221307:0:7068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789115338.468366:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115339.430238:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308201984:0@lo:400: 00000100:00100000:0.0:1789115339.430324:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115339.430419:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789115339.430425:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308201856:0@lo:400: 00000100:00100000:0.0:1789115339.430475:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115339.430509:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308201984 00000100:00100000:0.0:1789115339.430517:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308201984 00000100:00100000:3.0:1789115339.430683:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaada940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308201600:0@lo:400: 00000100:00100000:3.0:1789115339.430724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115339.430746:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789115339.430752:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaada1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308201728:0@lo:400: 00000100:00100000:3.0:1789115339.430772:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115339.430891:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789115339.430901:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308201984:12345-0@lo:400: 00000100:00100000:0.0:1789115339.430959:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308201984:12345-0@lo:400: Request processed in 59us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115339.430967:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789115339.430991:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308201856 00000100:00100000:0.0:1789115339.430995:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308201856 00000100:00100000:0.0:1789115339.431015:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308201728 00000100:00100000:0.0:1789115339.431018:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308201728 00000100:00100000:0.0:1789115339.431030:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789115339.431036:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308201856:12345-0@lo:400: 00000100:00100000:0.0:1789115339.431065:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308201856:12345-0@lo:400: Request processed in 29us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115339.431072:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789115339.431082:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789115339.431088:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308201728:12345-0@lo:400: 00000100:00100000:0.0:1789115339.431116:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308201728:12345-0@lo:400: Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115339.431132:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789115339.431148:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789115339.431153:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789115339.431184:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcdaada1c0 x1876023308201728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115339.431336:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308201600 00000100:00100000:1.0:1789115339.431340:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308201600 00000100:00100000:1.0:1789115339.431369:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789115339.431376:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+16:3305:x1876023308201600:12345-0@lo:400: 00000100:00100000:1.0:1789115339.431428:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+16:3305:x1876023308201600:12345-0@lo:400: Request processed in 53us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115339.431435:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789115339.431611:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaada1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308201728:0@lo:400: 00000100:00100000:0.0:1789115339.431625:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaada940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308201600:0@lo:400: 00000100:00100000:0.0:1789115339.431647:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308202112:0@lo:13: 00000100:00100000:0.0:1789115339.431676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789115339.431721:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcdaada580 x1876023308201856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115339.431732:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308201856:0@lo:400: 00010000:00080000:0.0:1789115339.431742:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcdaad9680 x1876023308201984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115339.431751:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308201984:0@lo:400: 00000100:00100000:1.0:1789115339.432308:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308202112 00000100:00100000:1.0:1789115339.432332:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308202112 00000100:00100000:1.0:1789115339.432375:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789115339.432406:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876023308202112:12345-0@lo:13: 00002000:00000024:1.0:1789115339.432441:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115339.432494:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876023308202112:12345-0@lo:13: Request processed in 111us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115339.432500:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789115339.432541:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcdaa71680 x1876023308202112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115339.432560:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308202112:0@lo:13: 00010000:00010000:3.0:1789115339.497043:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789115340.056487:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1789115340.516408:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115341.541713:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115342.563914:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115343.589637:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115344.548532:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308202496:0@lo:400: 00000100:00100000:3.0:1789115344.548570:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3421e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308202240:0@lo:400: 00000100:00100000:0.0:1789115344.548647:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd34203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308202368:0@lo:400: 00000100:00100000:1.0:1789115344.548724:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd34212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308202624:0@lo:400: 00000100:00100000:0.0:1789115344.550364:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115344.550478:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308202368 00000100:00100000:0.0:1789115344.550488:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308202368 00000100:00100000:0.0:1789115344.550545:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789115344.552693:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc331a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308202368:12345-0@lo:400: 00000100:00100000:0.0:1789115344.552916:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc331a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308202368:12345-0@lo:400: Request processed in 2361us (2556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115344.552923:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115344.552932:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789115344.553002:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308202240 00000100:00100000:3.0:1789115344.553011:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308202240 00010000:00080000:0.0:1789115344.553020:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd34203c0 x1876023308202368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115344.553037:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd34203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308202368:0@lo:400: 00000100:00100000:3.0:1789115344.553070:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789115344.553081:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+16:3306:x1876023308202240:12345-0@lo:400: 00000100:00100000:3.0:1789115344.553327:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+16:3306:x1876023308202240:12345-0@lo:400: Request processed in 247us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115344.553335:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789115344.553934:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3421e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308202240:0@lo:400: 00000100:00100000:2.0:1789115344.556548:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115344.557692:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308202752:0@lo:13: 00000100:00100000:2.0:1789115344.557777:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115344.557940:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308202752 00000100:00100000:3.0:1789115344.557952:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308202752 00000100:00100000:3.0:1789115344.558027:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789115344.558038:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd3421e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308202752:12345-0@lo:13: 00002000:00000024:3.0:1789115344.558079:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115344.558137:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd3421e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308202752:12345-0@lo:13: Request processed in 101us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115344.558144:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789115344.558210:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd35f43c0 x1876023308202752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115344.558232:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789115344.558255:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308202752:0@lo:13: 00000100:00100000:1.0:1789115344.558724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115344.558855:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308202624 00000100:00100000:3.0:1789115344.558860:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308202624 00000100:00100000:3.0:1789115344.558894:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789115344.558902:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308202624:12345-0@lo:400: 00000100:00100000:3.0:1789115344.558946:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308202624:12345-0@lo:400: Request processed in 46us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115344.558953:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789115344.558985:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd34212c0 x1876023308202624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115344.558996:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd34212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308202624:0@lo:400: 00000100:00080000:2.0:1789115344.559090:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789115344.564958:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308202496 00000100:00100000:3.0:1789115344.564975:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308202496 00000100:00100000:3.0:1789115344.565085:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789115344.565091:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115344.565098:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd3420b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308202496:12345-0@lo:400: 00000100:00100000:3.0:1789115344.565205:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd3420b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308202496:12345-0@lo:400: Request processed in 110us (8664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115344.565213:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789115344.565243:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd3423480 x1876023308202496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115344.565261:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308202496:0@lo:400: 00010000:00010000:2.0:1789115344.612813:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115345.639499:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115346.661320:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115347.687918:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115348.710020:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115349.667569:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd34212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308203136:0@lo:400: 00000100:00100000:2.0:1789115349.667650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115349.667709:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789115349.667716:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308203264:0@lo:400: 00000100:00100000:2.0:1789115349.667888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115349.667935:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308203136 00000100:00100000:2.0:1789115349.667944:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308203136 00000100:00100000:2.0:1789115349.668007:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789115349.668018:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd217c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308203136:12345-0@lo:400: 00000100:00100000:2.0:1789115349.668075:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd217c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308203136:12345-0@lo:400: Request processed in 59us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115349.668082:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789115349.668105:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308203264 00000100:00100000:2.0:1789115349.668109:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308203264 00000100:00100000:2.0:1789115349.668153:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789115349.668159:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd217e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308203264:12345-0@lo:400: 00000100:00100000:2.0:1789115349.668194:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd217e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308203264:12345-0@lo:400: Request processed in 35us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115349.668200:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789115349.668218:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789115349.668222:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789115349.668265:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd3420780 x1876023308203264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115349.668281:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308203264:0@lo:400: 00010000:00080000:2.0:1789115349.668293:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd34212c0 x1876023308203136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115349.668301:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd34212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308203136:0@lo:400: 00000100:00100000:1.0:1789115349.668421:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308203008:0@lo:400: 00000100:00100000:1.0:1789115349.668455:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115349.668478:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789115349.668483:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd34203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308202880:0@lo:400: 00000100:00100000:1.0:1789115349.668587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115349.668632:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308203008 00000100:00100000:1.0:1789115349.668637:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308203008 00000100:00100000:1.0:1789115349.668664:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789115349.668670:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308203008:12345-0@lo:400: 00000100:00100000:1.0:1789115349.668704:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308203008:12345-0@lo:400: Request processed in 34us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115349.668710:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789115349.669326:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308202880 00000100:00100000:1.0:1789115349.669333:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308202880 00000100:00100000:1.0:1789115349.669364:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789115349.669372:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:3308:x1876023308202880:12345-0@lo:400: 00000100:00100000:1.0:1789115349.669436:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:3308:x1876023308202880:12345-0@lo:400: Request processed in 65us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115349.669443:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789115349.669487:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd34203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308202880:0@lo:400: 00000100:00100000:3.0:1789115349.669661:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308203392:0@lo:13: 00000100:00100000:3.0:1789115349.669699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115349.669747:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308203392 00000100:00100000:3.0:1789115349.669760:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308203392 00000100:00100000:3.0:1789115349.669791:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789115349.669798:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308203392:12345-0@lo:13: 00002000:00000024:3.0:1789115349.669830:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115349.669868:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308203392:12345-0@lo:13: Request processed in 71us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115349.669874:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789115349.669908:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd35f4b40 x1876023308203392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115349.669926:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308203392:0@lo:13: 00010000:00080000:1.0:1789115349.670043:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd3423480 x1876023308203008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115349.670053:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308203008:0@lo:400: 00010000:00010000:1.0:1789115349.731526:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789115349.877082:0:7626:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789115349.877086:0:7626:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789115349.877230:0:7626:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dfcff92b000 00000020:01000004:2.0:1789115349.878607:0:7626:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789115349.878625:0:7626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789115349.878644:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8dfcd8a7b490) 00000020:00000080:2.0:1789115349.878662:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789115349.909004:0:7626:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789115349.909774:0:7626:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789115349.975352:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789115349.993647:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789115349.993688:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789115349.993868:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789115349.993903:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789115349.994918:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789115349.995003:0:7626:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789115349.995156:0:7626:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa47abda6516d2fd9 00000020:01000004:2.0:1789115349.995165:0:7626:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789115349.995188:0:7626:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789115349.995192:0:7626:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789115349.995199:0:7626:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789115349.995221:0:7626:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789115349.995226:0:7626:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789115350.027948:0:7626:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789115350.027993:0:7626:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789115350.027998:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789115350.028000:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789115350.028001:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115350.028003:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789115350.028004:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115350.028006:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115350.028008:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789115350.028010:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789115350.028012:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789115350.028014:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115350.028015:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789115350.028019:0:7626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789115350.028022:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789115350.028023:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789115350.028024:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115350.028025:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789115350.028026:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115350.028027:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115350.028028:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789115350.028029:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789115350.028031:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789115350.028032:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115350.028033:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789115350.028067:0:7626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789115350.028086:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308203520:0@lo:253: 00000100:00100000:2.0:1789115350.028158:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115350.028216:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bf480 going to sleep for 11 seconds 00000100:00100000:3.0:1789115350.028372:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308203520 00000100:00100000:3.0:1789115350.028408:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308203520 00000100:00100000:3.0:1789115350.028481:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789115350.028491:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+16:7626:x1876023308203520:12345-0@lo:253: 20000000:01000000:3.0:1789115350.028526:0:5846:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789115350.028531:0:5846:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789115350.028536:0:5846:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789115350.028539:0:5846:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789115350.029997:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789115350.030217:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789115350.030232:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789115350.030283:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789115350.030292:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789115350.030323:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789115350.030372:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789115350.033170:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789115350.033209:0:5846:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:3.0:1789115350.033218:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:3.0:1789115350.033270:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789115350.033280:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789115350.033345:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789115350.033355:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:3.0:1789115350.033868:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789115350.033881:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789115350.033914:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789115350.033966:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789115350.035330:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1789115350.035357:0:5846:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:3.0:1789115350.035360:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:3.0:1789115350.035543:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1789115350.035673:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789115350.035775:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1789115350.035785:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:3.0:1789115350.035815:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1789115350.035824:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789115350.035869:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1789115350.035905:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1789115350.035921:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789115350.035924:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789115350.035927:0:5846:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789115350.035941:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789115350.035944:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789115350.035978:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789115350.035981:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789115350.038195:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789115350.038326:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789115350.038360:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1789115350.038782:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1789115350.038828:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1789115350.038884:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1789115350.038899:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789115350.038902:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789115350.039685:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1789115350.039741:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1789115350.039794:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789115350.040117:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789115350.040171:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789115350.040228:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789115350.040252:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789115350.040255:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789115350.040842:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789115350.041120:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789115350.041159:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789115350.041251:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789115350.041265:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789115350.041267:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789115350.041862:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1789115350.041912:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1789115350.042341:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789115350.042563:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1789115350.042605:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1789115350.042642:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1789115350.042657:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1789115350.042659:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1789115350.042668:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789115350.042693:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.042712:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d2f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2f2a expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.042720:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d2f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2f54 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.042726:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfd021c5000/0xa47abda6516d2f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2f7e expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.042733:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d2fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2f9a expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.042740:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2fcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2fc4 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.042761:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.042810:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2fc4 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.042826:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2fcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2fc4 expref: 16 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115350.042843:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f4b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1876023308203648:0@lo:104: 00000100:00100000:3.0:1789115350.042913:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115350.043189:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789115350.043211:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308203648 00000100:00100000:2.0:1789115350.043219:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308203648 00000100:00100000:2.0:1789115350.043320:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789115350.043331:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd06eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+3:5846:x1876023308203648:12345-0@lo:104: 00010000:00010000:2.0:1789115350.043346:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2fcb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.043427:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789115350.043434:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd06eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+3:5846:x1876023308203648:12345-0@lo:104: Request processed in 105us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115350.043442:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789115350.043535:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115350.043543:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2fcb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.043549:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d2fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2f9a expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.043557:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d2fa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2f9a expref: 16 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115350.043567:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1876023308203776:0@lo:104: 00000100:00100000:3.0:1789115350.043591:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789115350.043661:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1520400 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:1.0:1789115350.043666:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2fcb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.043685:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2fcb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115350.043693:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2fcb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115350.043700:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789115350.043734:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2fcb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.043741:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115350.043759:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2fcb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.043766:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d2fc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2fcb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.043781:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115350.043783:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115350.043785:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115350.043808:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308203904:0@lo:103: 00000100:00100000:1.0:1789115350.043841:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115350.043883:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308203904 00000100:00100000:1.0:1789115350.043888:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308203904 00010000:00010000:1.0:1789115350.043907:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2fcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2fc4 expref: 17 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115350.043936:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789115350.043944:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa71680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:3308:x1876023308203904:12345-0@lo:103: 00010000:00010000:1.0:1789115350.043956:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115350.043961:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2fcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2fc4 expref: 17 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.043971:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2fcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2fc4 expref: 17 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.043989:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115350.044036:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa71680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:3308:x1876023308203904:12345-0@lo:103: Request processed in 93us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115350.044042:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789115350.044078:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308203904:0@lo:103: 00010000:00010000:3.0:1789115350.045006:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfd021c5000/0xa47abda6516d2f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2f7e expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.045020:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfd021c5000/0xa47abda6516d2f85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2f7e expref: 16 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115350.045033:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1876023308204032:0@lo:104: 00000100:00100000:3.0:1789115350.045072:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115350.046211:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308203776 00000100:00100000:0.0:1789115350.046222:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308203776 00000100:00100000:0.0:1789115350.046294:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789115350.046305:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+3:5846:x1876023308203776:12345-0@lo:104: 00010000:00010000:0.0:1789115350.046321:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2fa1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115350.047078:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789115350.047088:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+3:5846:x1876023308203776:12345-0@lo:104: Request processed in 784us (3494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115350.047096:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789115350.047603:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115350.047613:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2fa1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.047622:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95d800 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:1.0:1789115350.047626:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2fa1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115350.047634:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308204032 00010000:00010000:1.0:1789115350.047636:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2fa1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115350.047641:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308204032 10000000:00010000:1.0:1789115350.047643:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2fa1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115350.047666:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789115350.047705:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2fa1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.047712:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115350.047732:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2fa1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.047740:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d2f9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2fa1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.047756:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115350.047758:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115350.047759:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115350.047775:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308204160:0@lo:103: 00010000:00010000:3.0:1789115350.047810:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d2f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2f54 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115350.047824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789115350.047828:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d2f5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2f54 expref: 16 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115350.047839:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f6940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1876023308204288:0@lo:104: 00000100:00100000:3.0:1789115350.047862:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789115350.047878:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d2f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2f2a expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.047886:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d2f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2f2a expref: 16 pid: 5843 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115350.047895:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f7c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1876023308204416:0@lo:104: 00000100:00100000:3.0:1789115350.047932:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115350.047944:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519540 going to sleep for 11 seconds 00010000:00010000:3.0:1789115350.047966:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc1521a00/0xa47abda6516d2fcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2fc4 expref: 16 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115350.047978:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f4b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1876023308203648:0@lo:104: 00000100:00100000:3.0:1789115350.047988:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1876023308203776:0@lo:104: 00000100:00100000:2.0:1789115350.048034:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308204288 00000100:00100000:2.0:1789115350.048037:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308204288 00000100:00100000:2.0:1789115350.048065:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308204416 00000100:00100000:2.0:1789115350.048068:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308204416 00000100:00100000:2.0:1789115350.048082:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789115350.048091:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+5:5846:x1876023308204032:12345-0@lo:104: 00010000:00010000:2.0:1789115350.048101:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2f85 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.048157:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789115350.048163:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+5:5846:x1876023308204032:12345-0@lo:104: Request processed in 74us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115350.048170:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789115350.048187:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789115350.048189:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789115350.048192:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+4:5846:x1876023308204288:12345-0@lo:104: 00010000:00010000:1.0:1789115350.048195:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2f85 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.048199:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2f5b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.048201:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c5a00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:1.0:1789115350.048205:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2f85 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.048212:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2f85 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115350.048219:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2f85 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115350.048234:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789115350.048235:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789115350.048250:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+4:5846:x1876023308204288:12345-0@lo:104: Request processed in 48us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115350.048257:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789115350.048276:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789115350.048281:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+3:5846:x1876023308204416:12345-0@lo:104: 00010000:00010000:1.0:1789115350.048283:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f85 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.048288:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2f31 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.048289:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115350.048299:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f85 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.048307:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5a00/0xa47abda6516d2f7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f85 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.048312:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789115350.048316:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+3:5846:x1876023308204416:12345-0@lo:104: Request processed in 35us (384us total) trans 0 rc 0/0 00010000:00010000:1.0:1789115350.048319:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789115350.048322:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2f5b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115350.048323:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789115350.048329:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95dc00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:1.0:1789115350.048332:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2f5b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.048336:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115350.048339:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2f5b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115350.048346:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2f5b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115350.048351:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789115350.048363:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f5b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.048369:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115350.048409:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f5b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.048415:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d2f54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f5b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.048426:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115350.048428:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115350.048429:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115350.048439:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308204672:0@lo:103: 00000100:00100000:1.0:1789115350.048466:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115350.048497:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308204160 00000100:00100000:1.0:1789115350.048501:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308204160 00010000:00010000:1.0:1789115350.048519:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d2fa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2f9a expref: 16 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115350.048526:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308204672 00000100:00100000:0.0:1789115350.048530:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308204672 00000100:00100000:1.0:1789115350.048539:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789115350.048544:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa70f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d846835-79f9-4361-81d5-b56fc2e9378a+17:3305:x1876023308204160:12345-0@lo:103: 00010000:00010000:0.0:1789115350.048544:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d2f5b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2f54 expref: 17 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.048554:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115350.048560:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d2fa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2f9a expref: 17 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.048572:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d2fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2f9a expref: 17 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115350.048573:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789115350.048578:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:3307:x1876023308204672:12345-0@lo:103: 00010000:00010000:0.0:1789115350.048585:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115350.048586:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d2fa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2f9a expref: 17 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115350.048594:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d2f5b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2f54 expref: 16 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.048600:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115350.048601:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d2f5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2f54 expref: 16 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115350.048610:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115350.048622:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa70f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d846835-79f9-4361-81d5-b56fc2e9378a+16:3305:x1876023308204160:12345-0@lo:103: Request processed in 77us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115350.048633:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:3307:x1876023308204672:12345-0@lo:103: Request processed in 55us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115350.048634:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789115350.048638:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789115350.048656:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308204544:0@lo:103: 00000100:00100000:1.0:1789115350.048682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115350.048740:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308204672:0@lo:103: 00000100:00100000:1.0:1789115350.048770:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308204160:0@lo:103: 00000100:00100000:1.0:1789115350.048792:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308204544 00000100:00100000:1.0:1789115350.048796:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308204544 00010000:00010000:1.0:1789115350.048809:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfd021c5000/0xa47abda6516d2f85 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2f7e expref: 15 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115350.048829:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789115350.048836:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:3306:x1876023308204544:12345-0@lo:103: 00010000:00010000:1.0:1789115350.048844:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115350.048848:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfd021c5000/0xa47abda6516d2f85 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2f7e expref: 15 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.048855:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfd021c5000/0xa47abda6516d2f85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2f7e expref: 15 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.048864:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115350.048895:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:3306:x1876023308204544:12345-0@lo:103: Request processed in 61us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115350.048901:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789115350.048924:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308204544:0@lo:103: 00010000:00010000:0.0:1789115350.049862:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfd021c5000/0xa47abda6516d2f85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2f7e expref: 14 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115350.049876:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1876023308204032:0@lo:104: 00010000:00010000:0.0:1789115350.049887:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d2f5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2f54 expref: 13 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115350.049896:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f6940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1876023308204288:0@lo:104: 00000100:00100000:0.0:1789115350.049903:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f7c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5846:1876023308204416:0@lo:104: 00010000:00010000:0.0:1789115350.049932:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.051139:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115350.051144:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115350.051146:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115350.051167:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2f31 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.051179:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c4e00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:2.0:1789115350.051184:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2f31 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.051194:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2f31 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789115350.051202:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2f31 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115350.051208:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789115350.051341:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f31 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.051348:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789115350.051378:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f31 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.051408:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d2f2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f31 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115350.051432:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3422d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308204800:0@lo:103: 00010000:00010000:2.0:1789115350.051433:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115350.051436:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115350.051439:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115350.052270:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115350.052693:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308204800 00000100:00100000:1.0:1789115350.052704:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308204800 00010000:00010000:1.0:1789115350.052954:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d2f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2f2a expref: 13 pid: 5843 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115350.053034:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789115350.053045:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+13:3308:x1876023308204800:12345-0@lo:103: 00010000:00010000:1.0:1789115350.053062:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115350.053068:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d2f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2f2a expref: 13 pid: 5843 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.053082:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d2f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2f2a expref: 13 pid: 5843 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.053102:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d2f31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2f2a expref: 13 pid: 5843 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.053118:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.053139:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.053157:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.053165:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.053172:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.053179:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.053195:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c4800 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115350.053199:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.053209:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.053229:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.053253:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115350.053315:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+12:3308:x1876023308204800:12345-0@lo:103: Request processed in 271us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115350.053323:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789115350.053418:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3422d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308204800:0@lo:103: 00010000:00010000:0.0:1789115350.054491:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115350.054630:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115350.054638:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d2fe0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789115350.054672:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789115350.105118:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+11:7626:x1876023308203520:12345-0@lo:253: Request processed in 76618us (76950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115350.105173:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789115350.105618:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308203520:0@lo:253: 10000000:01000000:2.0:1789115350.105636:0:7626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789115350.105640:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789115350.105642:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789115350.105643:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115350.105645:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789115350.105646:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115350.105647:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115350.105649:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789115350.105651:0:7626:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789115350.105653:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115350.105654:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789115350.105678:0:7626:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dfcff92b000 from lustre-OST0001 10000000:01000000:2.0:1789115350.105705:0:7626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789115350.105709:0:7626:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789115350.105718:0:7626:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dfcd92d3490 local copy 10000000:01000000:2.0:1789115350.105794:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789115350.105842:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.105854:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.105873:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115350.105895:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308204928:0@lo:101: 00000100:00100000:2.0:1789115350.105942:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115350.106057:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc62d4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789115350.106288:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308204928 00000100:00100000:1.0:1789115350.106298:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308204928 00000100:00100000:1.0:1789115350.106418:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789115350.106429:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+11:7626:x1876023308204928:12345-0@lo:101: 00010000:00010000:1.0:1789115350.106446:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115350.106465:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcda95dc00/0xa47abda6516d2fee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2fe7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.106497:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcda95dc00/0xa47abda6516d2fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2fe7 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.106509:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcda95dc00/0xa47abda6516d2fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2fe7 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.106520:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcda95dc00, rc 0) 00000100:00100000:1.0:1789115350.106580:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+12:7626:x1876023308204928:12345-0@lo:101: Request processed in 153us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115350.106587:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789115350.106664:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308204928:0@lo:101: 00010000:00010000:3.0:1789115350.106679:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa47abda6516d2fee expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.106689:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa47abda6516d2fee expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115350.106808:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308205056:0@lo:501: 00000100:00100000:3.0:1789115350.106854:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115350.107636:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee5196c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115350.107729:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308205056 00000100:00100000:2.0:1789115350.107736:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308205056 00000100:00100000:2.0:1789115350.107772:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789115350.107781:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:7626:x1876023308205056:12345-0@lo:501: 00000100:00100000:2.0:1789115350.108420:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:7626:x1876023308205056:12345-0@lo:501: Request processed in 637us (1562us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789115350.108429:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789115350.108702:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308205056:0@lo:501: 10000000:01000000:3.0:1789115350.108741:0:7626:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789115350.108782:0:7626:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789115350.108790:0:7626:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa47abda6516d2fee expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.108801:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa47abda6516d2fee expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.108809:0:7626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa47abda6516d2fee expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.108868:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789115350.108895:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dfcff92b000 10000000:01000000:3.0:1789115350.108900:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789115350.108907:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789115350.108920:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789115350.108926:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789115350.108929:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789115350.108963:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.108971:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.108980:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115350.109000:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308205184:0@lo:101: 00000100:00100000:3.0:1789115350.109045:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115350.109076:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519780 going to sleep for 11 seconds 00000100:00100000:2.0:1789115350.109499:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308205184 00000100:00100000:2.0:1789115350.109507:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308205184 00000100:00100000:2.0:1789115350.109554:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789115350.109563:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:7626:x1876023308205184:12345-0@lo:101: 00010000:00010000:2.0:1789115350.109578:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115350.109593:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2ffc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d2ff5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.109619:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d2ff5 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.109630:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2ff5 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.109640:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1520e00, rc 0) 00000100:00100000:2.0:1789115350.109689:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308205184:12345-0@lo:101: Request processed in 127us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115350.109694:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789115350.109792:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308205184:0@lo:101: 00010000:00010000:3.0:1789115350.109808:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2ffc expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.109817:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2ffc expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115350.109920:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308205312:0@lo:501: 00000100:00100000:3.0:1789115350.109949:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115350.109978:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519780 going to sleep for 11 seconds 00000100:00100000:2.0:1789115350.110031:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308205312 00000100:00100000:2.0:1789115350.110036:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308205312 00000100:00100000:2.0:1789115350.110065:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789115350.110073:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308205312:12345-0@lo:501: 00000100:00100000:2.0:1789115350.110313:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308205312:12345-0@lo:501: Request processed in 241us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115350.110321:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789115350.110518:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308205312:0@lo:501: 00000100:00100000:3.0:1789115350.110548:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308205440:0@lo:503: 00000100:00100000:3.0:1789115350.110587:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115350.110621:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519780 going to sleep for 11 seconds 00000100:00100000:0.0:1789115350.110770:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308205440 00000100:00100000:0.0:1789115350.110776:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308205440 00000100:00100000:0.0:1789115350.110804:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789115350.110813:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308205440:12345-0@lo:503: 00000100:00100000:0.0:1789115350.111351:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308205440:12345-0@lo:503: Request processed in 537us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115350.111359:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789115350.111437:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308205440:0@lo:503: 00000040:00080000:0.0:1789115350.111713:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789115350.111997:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308205568:0@lo:502: 00000100:00100000:0.0:1789115350.112050:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115350.112122:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcedacfe40 going to sleep for 11 seconds 00010000:00010000:1.0:1789115350.112296:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115350.112305:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa47abda6516d2fee expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.112317:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521400 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:1.0:1789115350.112321:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa47abda6516d2fee expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.112332:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa47abda6516d2fee expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115350.112340:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa47abda6516d2fee expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115350.112347:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789115350.112374:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa47abda6516d2fee expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.112408:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115350.112432:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa47abda6516d2fee expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.112440:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d2fe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa47abda6516d2fee expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.112455:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115350.112457:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115350.112459:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115350.112511:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789115350.112524:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308205696:0@lo:103: 00000100:00100000:0.0:1789115350.112554:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115350.112625:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308205696 00000100:00100000:1.0:1789115350.112632:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308205696 00000100:00100000:1.0:1789115350.112681:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789115350.112690:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc333c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:3306:x1876023308205696:12345-0@lo:103: 00010000:00010000:1.0:1789115350.112703:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115350.112719:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcda95dc00/0xa47abda6516d2fee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d2fe7 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.112744:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115350.112780:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc333c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:3306:x1876023308205696:12345-0@lo:103: Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115350.112787:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789115350.112917:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308205696:0@lo:103: 00000100:00100000:3.0:1789115350.113022:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308205568 00000100:00100000:3.0:1789115350.113027:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308205568 00000100:00100000:3.0:1789115350.113091:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789115350.113102:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:7626:x1876023308205568:12345-0@lo:502: 00000100:00100000:3.0:1789115350.113457:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:7626:x1876023308205568:12345-0@lo:502: Request processed in 358us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115350.113464:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789115350.113545:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308205568:0@lo:502: 00000040:00080000:0.0:1789115350.113848:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789115350.113907:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789115350.113937:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789115350.113965:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789115350.113984:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789115350.114000:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789115350.114025:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308205824:0@lo:502: 00000100:00100000:0.0:1789115350.114064:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115350.114550:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308205824 00000100:00100000:1.0:1789115350.114558:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308205824 00000100:00100000:0.0:1789115350.114587:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcedacfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789115350.114624:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789115350.114633:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:7626:x1876023308205824:12345-0@lo:502: 00000100:00100000:3.0:1789115350.114854:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+12:7626:x1876023308205824:12345-0@lo:502: Request processed in 221us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115350.114861:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789115350.114937:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308205824:0@lo:502: 00000040:00080000:0.0:1789115350.115031:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789115350.115043:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789115350.115523:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789115350.115532:0:7635:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789115350.115540:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115350.115542:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789115350.115546:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789115350.115563:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8dfcfcfcced8) 00000020:00000080:0.0:1789115350.115584:0:7635:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789115350.115588:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789115350.115665:0:7635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dfcff92b000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789115350.115672:0:7635:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789115350.115681:0:7635:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa47abda6516d300a 00010000:00010000:0.0:1789115350.119119:0:7635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1789115350.120013:0:7635:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789115350.122202:0:7635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789115350.122607:0:7635:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789115350.126693:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789115350.128105:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789115350.135062:0:7635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789115350.135074:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789115350.135080:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115350.135082:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789115350.135086:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789115350.135089:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115350.135091:0:7635:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789115350.135095:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789115350.135097:0:7635:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789115350.135140:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789115350.135143:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115350.135145:0:7635:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789115350.135148:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789115350.136279:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789115350.136305:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789115350.136333:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2ffc expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.136347:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2ffc expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115350.136356:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcff92b000 from 1 10000000:01000000:1.0:1789115350.136359:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789115350.136429:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.136438:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.136451:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115350.136483:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308205952:0@lo:101: 00000100:00100000:1.0:1789115350.136553:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115350.136601:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789115350.137302:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308205952 00000100:00100000:3.0:1789115350.137312:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308205952 00000100:00100000:3.0:1789115350.137364:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789115350.137375:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:7626:x1876023308205952:12345-0@lo:101: 00010000:00010000:3.0:1789115350.137417:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115350.137434:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3018 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d3011 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.137467:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d3011 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.137480:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3011 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.137490:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c5c00, rc 0) 00000100:00100000:3.0:1789115350.137561:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308205952:12345-0@lo:101: Request processed in 187us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115350.137568:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789115350.137869:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308205952:0@lo:101: 00010000:00010000:2.0:1789115350.137888:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3018 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115350.137897:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3018 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115350.139724:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3423840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206080:0@lo:501: 00000100:00100000:2.0:1789115350.139796:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115350.139834:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc62d4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789115350.140547:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308206080 00000100:00100000:3.0:1789115350.140558:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308206080 00000100:00100000:3.0:1789115350.140618:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789115350.140630:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308206080:12345-0@lo:501: 00000100:00100000:3.0:1789115350.140935:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308206080:12345-0@lo:501: Request processed in 306us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115350.140942:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789115350.141845:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3423840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206080:0@lo:501: 00000100:00100000:1.0:1789115350.141902:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206208:0@lo:503: 00000100:00100000:1.0:1789115350.141955:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115350.141989:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115350.142060:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308206208 00000100:00100000:2.0:1789115350.142066:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308206208 00000100:00100000:2.0:1789115350.142101:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789115350.142108:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308206208:12345-0@lo:503: 00000100:00100000:2.0:1789115350.142567:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308206208:12345-0@lo:503: Request processed in 457us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115350.142574:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789115350.148871:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206208:0@lo:503: 00000040:00080000:1.0:1789115350.149449:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789115350.149549:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206336:0@lo:502: 00000100:00100000:1.0:1789115350.149621:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115350.149666:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789115350.149694:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308206336 00000100:00100000:1.0:1789115350.149701:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308206336 00000100:00100000:1.0:1789115350.151403:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789115350.151421:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308206336:12345-0@lo:502: 00000100:00100000:1.0:1789115350.151696:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308206336:12345-0@lo:502: Request processed in 281us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115350.151705:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789115350.151769:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206336:0@lo:502: 00000040:00080000:1.0:1789115350.152030:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789115350.152078:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789115350.152116:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206464:0@lo:502: 00000100:00100000:1.0:1789115350.152157:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115350.152191:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115350.152443:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308206464 00000100:00100000:0.0:1789115350.152449:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308206464 00000100:00100000:0.0:1789115350.152480:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789115350.152488:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308206464:12345-0@lo:502: 00000100:00100000:0.0:1789115350.152632:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308206464:12345-0@lo:502: Request processed in 145us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115350.152639:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789115350.152702:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206464:0@lo:502: 00000040:00080000:0.0:1789115350.152996:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789115350.153008:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789115350.154133:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789115350.154142:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115350.154145:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789115350.154152:0:7639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dfcff92b000 00000020:00000080:0.0:1789115350.154154:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789115350.154230:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789115350.154234:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115350.154236:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789115350.154239:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789115350.154374:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789115350.154587:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789115350.154647:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3018 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.154661:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3018 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115350.154701:0:7626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789115350.154704:0:7626:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dfcff92b000 10000000:01000000:1.0:1789115350.154708:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dfcff92b000 10000000:01000000:1.0:1789115350.154712:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789115350.154718:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dfcff92b000 from 1 10000000:01000000:1.0:1789115350.154731:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789115350.154770:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.154777:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115350.154789:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115350.154810:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206592:0@lo:101: 00000100:00100000:1.0:1789115350.154878:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115350.154921:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115350.155024:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308206592 00000100:00100000:0.0:1789115350.155031:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308206592 00000100:00100000:0.0:1789115350.155072:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789115350.155081:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308206592:12345-0@lo:101: 00010000:00010000:0.0:1789115350.155095:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115350.155109:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d3026 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d301f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115350.155133:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d3026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d301f expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115350.155144:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d3026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d301f expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115350.155153:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28fc00, rc 0) 00000100:00100000:0.0:1789115350.155208:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+14:7626:x1876023308206592:12345-0@lo:101: Request processed in 128us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115350.155215:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789115350.155370:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206592:0@lo:101: 00010000:00010000:3.0:1789115350.155410:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3026 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.155419:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3026 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115350.155510:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206720:0@lo:501: 00000100:00100000:3.0:1789115350.155538:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115350.155556:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519300 going to sleep for 11 seconds 00000100:00100000:1.0:1789115350.155613:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308206720 00000100:00100000:1.0:1789115350.155617:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308206720 00000100:00100000:1.0:1789115350.155641:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789115350.155646:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+14:7626:x1876023308206720:12345-0@lo:501: 00000100:00100000:1.0:1789115350.155887:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+14:7626:x1876023308206720:12345-0@lo:501: Request processed in 239us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115350.155894:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789115350.156015:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206720:0@lo:501: 00000100:00100000:3.0:1789115350.156043:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206848:0@lo:503: 00000100:00100000:3.0:1789115350.156081:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115350.156107:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519300 going to sleep for 11 seconds 00000100:00100000:0.0:1789115350.156159:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308206848 00000100:00100000:0.0:1789115350.156173:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308206848 00000100:00100000:0.0:1789115350.156193:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789115350.156199:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+14:7626:x1876023308206848:12345-0@lo:503: 00000100:00100000:0.0:1789115350.156348:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+14:7626:x1876023308206848:12345-0@lo:503: Request processed in 147us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115350.156355:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789115350.156533:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206848:0@lo:503: 00000040:00080000:3.0:1789115350.156806:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789115350.156859:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206976:0@lo:502: 00000100:00100000:3.0:1789115350.156894:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115350.156922:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519300 going to sleep for 11 seconds 00000100:00100000:0.0:1789115350.157019:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308206976 00000100:00100000:0.0:1789115350.157024:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308206976 00000100:00100000:0.0:1789115350.157048:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789115350.157055:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+14:7626:x1876023308206976:12345-0@lo:502: 00000100:00100000:0.0:1789115350.157279:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+14:7626:x1876023308206976:12345-0@lo:502: Request processed in 224us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115350.157286:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789115350.157352:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308206976:0@lo:502: 00000040:00080000:3.0:1789115350.157604:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789115350.157649:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789115350.157679:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789115350.157789:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789115350.157831:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789115350.157876:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789115350.157907:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789115350.157937:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789115350.157980:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789115350.158015:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789115350.158046:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789115350.158106:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789115350.158149:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789115350.158499:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789115350.158552:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789115350.158589:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789115350.158622:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789115350.158670:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789115350.158705:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789115350.158809:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789115350.158853:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789115350.158881:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789115350.158906:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789115350.158942:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789115350.158969:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789115350.158995:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789115350.159030:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789115350.159057:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1789115350.159082:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789115350.159131:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1789115350.159162:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1789115350.159552:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1789115350.159589:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1789115350.159654:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1789115350.159703:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1789115350.159829:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1789115350.159867:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1789115350.159920:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308207104:0@lo:502: 00000100:00100000:3.0:1789115350.160002:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115350.160082:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519300 going to sleep for 11 seconds 00000100:00100000:0.0:1789115350.160125:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308207104 00000100:00100000:0.0:1789115350.160133:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308207104 00000100:00100000:0.0:1789115350.160272:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789115350.160282:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+14:7626:x1876023308207104:12345-0@lo:502: 00000100:00100000:0.0:1789115350.160637:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+14:7626:x1876023308207104:12345-0@lo:502: Request processed in 355us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115350.160645:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789115350.160793:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308207104:0@lo:502: 00000040:00080000:3.0:1789115350.160874:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789115350.160885:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789115350.161510:0:7640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789115350.161536:0:7640:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8dfcfbfc3490) 00000020:00000080:0.0:1789115350.161557:0:7640:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1789115350.161640:0:7640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dfcff92b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789115350.161645:0:7640:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dfcff92b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789115350.161648:0:7640:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dfcff92b000 3 00010000:00080000:0.0:1789115350.161678:0:7640:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dfcfbfcb800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1789115350.164058:0:7640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1789115350.164570:0:7640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789115350.164611:0:7640:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789115350.164623:0:7640:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa47abda6516d3034 00000100:00080000:0.0:1789115350.164635:0:7640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789115350.164641:0:7640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dfcfbfcb800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1789115350.164685:0:7640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfcfc332580 x1876023308207232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789115350.164705:0:7640:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789115350.164952:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876023308207232:0@lo:38: 00000100:00100000:1.0:1789115350.165032:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115350.165133:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308207232 00000100:00100000:0.0:1789115350.165141:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308207232 00000100:00100000:2.0:1789115350.165328:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789115350.165338:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd34203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308207360:0@lo:400: 00000100:00100000:2.0:1789115350.165365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115350.167418:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308207616:0@lo:400: 00000100:00100000:2.0:1789115350.167477:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115350.167501:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789115350.167507:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd34212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308207488:0@lo:400: 00000100:00100000:2.0:1789115350.167530:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115350.167678:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308207360 00000100:00100000:0.0:1789115350.167687:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308207360 00000100:00100000:0.0:1789115350.167745:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789115350.167755:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd3423840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308207360:12345-0@lo:400: 00000100:00100000:0.0:1789115350.167840:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd3423840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308207360:12345-0@lo:400: Request processed in 86us (2473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115350.167847:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789115350.167870:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789115350.167874:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1876023308207232:12345-0@lo:38: 00010000:00080000:0.0:1789115350.167899:0:5851:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:0.0:1789115350.167942:0:5851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa47abda6516d303b 00000004:00100000:0.0:1789115350.167961:0:5851:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789115350.167998:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8dfcfbfca000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789115350.168043:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876023308207232:12345-0@lo:38: Request processed in 167us (3010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115350.168050:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789115350.168111:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd34203c0 x1876023308207360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115350.168127:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd34203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308207360:0@lo:400: 00010000:00080000:0.0:1789115350.168177:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcfc332580 x1876023308207232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789115360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115350.168185:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789115350.168192:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789115350.168201:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789115350.168205:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789115350.168208:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcfbfcb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789115350.168214:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876023308207232:0@lo:38: 00000100:00100000:2.0:1789115350.168508:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308207616 00000100:00100000:2.0:1789115350.168514:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308207616 00000100:00100000:2.0:1789115350.168548:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789115350.168556:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd3423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308207616:12345-0@lo:400: 00000100:00100000:2.0:1789115350.168596:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd3423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308207616:12345-0@lo:400: Request processed in 41us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115350.168603:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789115350.168644:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd3420780 x1876023308207616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115350.168655:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308207616:0@lo:400: 00000100:00100000:3.0:1789115350.168792:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308207488 00000100:00100000:3.0:1789115350.168802:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308207488 00000040:00080000:2.0:1789115350.168993:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1789115350.169131:0:7641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7641:1876023308207744:0@lo:901: 00000100:00100000:2.0:1789115350.169185:0:7641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115350.169202:0:7641:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc62d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1789115350.169355:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789115350.169366:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd3422d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308207488:12345-0@lo:400: 00000100:00100000:0.0:1789115350.169667:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd3422d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308207488:12345-0@lo:400: Request processed in 302us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115350.169673:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789115350.169770:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd34212c0 x1876023308207488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115350.169784:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd34212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308207488:0@lo:400: 00000100:00100000:1.0:1789115350.169907:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308207744 00000100:00100000:1.0:1789115350.169913:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308207744 00000100:00100000:1.0:1789115350.169999:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789115350.170009:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd34203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7641:x1876023308207744:12345-0@lo:901: 00000100:00100000:1.0:1789115350.170508:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd34203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7641:x1876023308207744:12345-0@lo:901: Request processed in 501us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115350.170516:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789115350.170570:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:3.0:1789115350.170663:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789115350.170693:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789115350.170710:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3026 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.170733:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3026 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789115350.170784:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789115350.170787:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789115350.170788:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789115350.170789:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789115350.170791:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789115350.170792:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789115350.170794:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789115350.170796:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789115350.170797:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789115350.170799:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789115350.170801:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789115350.170805:0:7626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789115350.170807:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789115350.170809:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789115350.170810:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789115350.170811:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789115350.170812:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789115350.170813:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789115350.170814:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789115350.170815:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789115350.170817:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789115350.170818:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789115350.170819:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789115350.170840:0:7626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789115350.170853:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308207872:0@lo:253: 00000100:00100000:3.0:1789115350.170899:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115350.170931:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519540 going to sleep for 11 seconds 00000100:00100000:1.0:1789115350.171135:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308207872 00000100:00100000:1.0:1789115350.171143:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308207872 00000100:00100000:1.0:1789115350.171310:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789115350.171320:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+14:7626:x1876023308207872:12345-0@lo:253: 20000000:01000000:1.0:1789115350.171364:0:5843:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789115350.171378:0:5843:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1789115350.171823:0:7641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcd3420780 x1876023308207744/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789115366 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115350.171839:0:7641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7641:1876023308207744:0@lo:901: 20000000:01000000:1.0:1789115350.197104:0:5843:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789115350.197120:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789115350.197181:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789115350.197187:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789115350.197211:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.197232:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d2f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2f8c expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.197250:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.197297:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d2f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2f8c expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.197312:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d2f93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2f8c expref: 14 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115350.197328:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e9a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1876023308208000:0@lo:104: 00000100:00100000:3.0:1789115350.197467:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115350.197513:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd97196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789115350.197548:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308208000 00000100:00100000:3.0:1789115350.197555:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308208000 00000100:00100000:3.0:1789115350.197606:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789115350.197616:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+3:5866:x1876023308208000:12345-0@lo:104: 00010000:00010000:3.0:1789115350.197633:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2f93 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.197687:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789115350.197694:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+3:5866:x1876023308208000:12345-0@lo:104: Request processed in 79us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115350.197702:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789115350.197758:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115350.197765:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2f93 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.197773:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f800 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115350.197778:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2f93 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.197788:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2f93 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115350.197796:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2f93 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115350.197802:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789115350.197830:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f93 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.197836:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115350.197854:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f93 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.197862:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f800/0xa47abda6516d2f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f93 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.197878:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115350.197880:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115350.197882:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115350.197892:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308208128:0@lo:103: 00000100:00100000:3.0:1789115350.197921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115350.197952:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308208128 00000100:00100000:3.0:1789115350.197961:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308208128 00010000:00010000:3.0:1789115350.197978:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d2f93 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2f8c expref: 15 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115350.198000:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789115350.198006:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:3305:x1876023308208128:12345-0@lo:103: 00010000:00010000:3.0:1789115350.198016:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115350.198022:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d2f93 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2f8c expref: 15 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.198032:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d2f93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2f8c expref: 15 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.198050:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.198059:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789115350.198073:0:5837:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001482325s 00010000:00010000:3.0:1789115350.198077:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.198084:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.198091:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.198098:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.198113:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c4400 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115350.198118:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.198126:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.198135:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.198144:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115350.198169:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:3305:x1876023308208128:12345-0@lo:103: Request processed in 163us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115350.198175:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789115350.198238:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308208128:0@lo:103: 00010000:00010000:3.0:1789115350.198275:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d2f93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2f8c expref: 14 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115350.198285:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e9a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1876023308208000:0@lo:104: 00010000:00010000:3.0:1789115350.198296:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.198303:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.198309:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115350.198315:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfd021c4400/0xa47abda6516d3042 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115350.225578:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:7626:x1876023308207872:12345-0@lo:253: Request processed in 54250us (54668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115350.225593:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789115350.225756:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d846835-79f9-4361-81d5-b56fc2e9378a:7626:1876023308207872:0@lo:253: 10000000:01000000:3.0:1789115350.225772:0:7626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789115350.225776:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789115350.225778:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789115350.225779:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789115350.225781:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789115350.225782:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789115350.225784:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789115350.225785:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789115350.225787:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789115350.225789:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789115350.225791:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789115350.225792:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789115350.225808:0:7626:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789115350.238430:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789115350.238610:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789115350.239149:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789115350.239888:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789115350.240280:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789115350.247279:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789115350.248616:0:7626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789115350.510017:0:7626:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789115350.510025:0:7626:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789115350.510062:0:7626:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789115350.510127:0:7626:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789115350.510143:0:7626:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789115350.510173:0:7626:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789115350.756808:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115351.784118:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115352.803571:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115353.827821:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115354.793005:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789115354.793033:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308208256:0@lo:13: 00000100:00100000:1.0:1789115354.800152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115354.801592:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308208256 00000100:00100000:3.0:1789115354.801610:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308208256 00000100:00100000:3.0:1789115354.801701:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789115354.801714:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308208256:12345-0@lo:13: 00002000:00000024:3.0:1789115354.801770:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115354.801855:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308208256:12345-0@lo:13: Request processed in 144us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115354.801864:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789115354.801891:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789115354.801931:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f0f00 x1876023308208256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115354.801955:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308208256:0@lo:13: 00010000:00010000:1.0:1789115354.852415:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115355.305479:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308208384:0@lo:400: 00000100:00100000:3.0:1789115355.305609:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115355.308360:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115355.308404:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308208512:0@lo:400: 00000100:00100000:3.0:1789115355.308488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115355.309664:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308208512 00000100:00100000:2.0:1789115355.309678:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308208512 00000100:00100000:2.0:1789115355.309743:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789115355.309755:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308208512:12345-0@lo:400: 00000100:00100000:2.0:1789115355.309856:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308208512:12345-0@lo:400: Request processed in 103us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.309864:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789115355.309920:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc3321c0 x1876023308208512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115355.309937:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308208512:0@lo:400: 00000100:00100000:0.0:1789115355.310427:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308208384 00000100:00100000:0.0:1789115355.310433:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308208384 00000100:00100000:0.0:1789115355.310462:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789115355.310470:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+13:3307:x1876023308208384:12345-0@lo:400: 00000100:00100000:0.0:1789115355.310514:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+13:3307:x1876023308208384:12345-0@lo:400: Request processed in 45us (4908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115355.310520:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789115355.310561:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc333840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308208768:0@lo:400: 00000100:00100000:0.0:1789115355.310603:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115355.310630:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789115355.310636:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876023308208640:0@lo:400: 00000100:00100000:0.0:1789115355.310658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115355.310789:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308208768 00000100:00100000:2.0:1789115355.310794:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308208768 00000100:00100000:2.0:1789115355.310901:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308208640 00000100:00100000:2.0:1789115355.310905:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308208640 00000100:00100000:0.0:1789115355.310940:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789115355.310948:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308208768:12345-0@lo:400: 00000100:00100000:0.0:1789115355.310984:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308208768:12345-0@lo:400: Request processed in 37us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115355.310990:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789115355.311018:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc333840 x1876023308208768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115355.311029:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc333840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308208768:0@lo:400: 00000100:00080000:3.0:1789115355.311648:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115355.311785:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789115355.311794:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc330b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876023308208640:12345-0@lo:400: 00000100:00100000:2.0:1789115355.311849:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc330b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876023308208640:12345-0@lo:400: Request processed in 58us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.311855:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789115355.311883:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc333480 x1876023308208640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115355.311894:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876023308208640:0@lo:400: 00000100:00100000:2.0:1789115355.311936:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308208384:0@lo:400: 10000000:01000000:3.0:1789115355.811468:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789115355.811476:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dfcd8ba8800 from 30 10000000:01000000:3.0:1789115355.811482:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789115355.811535:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115355.811547:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115355.811560:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115355.811584:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308208896:0@lo:101: 00000100:00100000:3.0:1789115355.811663:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115355.811740:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876600 going to sleep for 11 seconds 00000100:00100000:2.0:1789115355.811910:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308208896 00000100:00100000:2.0:1789115355.811920:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308208896 00000100:00100000:2.0:1789115355.811973:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789115355.811984:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:5848:x1876023308208896:12345-0@lo:101: 00010000:00010000:2.0:1789115355.811999:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115355.812014:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d3050 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d3049 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.812041:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d3050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d3049 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.812053:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d3050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3049 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.812065:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1521e00, rc 0) 00000100:00100000:2.0:1789115355.812106:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308208896:12345-0@lo:101: Request processed in 123us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.812114:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789115355.815578:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308208896:0@lo:101: 00010000:00010000:3.0:1789115355.815613:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3050 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115355.815628:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3050 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115355.815735:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308209024:0@lo:501: 00000100:00100000:3.0:1789115355.815802:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115355.815843:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876600 going to sleep for 11 seconds 00000100:00100000:2.0:1789115355.817064:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308209024 00000100:00100000:2.0:1789115355.817078:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308209024 00000100:00100000:2.0:1789115355.817139:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789115355.817311:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308209024:12345-0@lo:501: 00000100:00100000:2.0:1789115355.818577:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308209024:12345-0@lo:501: Request processed in 1268us (2770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.818590:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789115355.819282:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308209024:0@lo:501: 00000100:00100000:0.0:1789115355.819339:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc333840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308209152:0@lo:503: 00000100:00100000:0.0:1789115355.819413:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115355.819448:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789115355.819610:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308209152 00000100:00100000:2.0:1789115355.819617:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308209152 00000100:00100000:2.0:1789115355.819667:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789115355.819676:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308209152:12345-0@lo:503: 00000100:00100000:2.0:1789115355.821050:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308209152:12345-0@lo:503: Request processed in 1368us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.821062:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789115355.821140:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc333840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308209152:0@lo:503: 00000100:00100000:0.0:1789115355.833303:0:7928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7928:1876023308209280:0@lo:502: 00000100:00100000:0.0:1789115355.833434:0:7928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115355.833482:0:7928:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789115355.833738:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308209280 00000100:00100000:2.0:1789115355.833747:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308209280 00000100:00100000:2.0:1789115355.833800:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789115355.833810:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+14:7928:x1876023308209280:12345-0@lo:502: 00000100:00100000:2.0:1789115355.834335:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+14:7928:x1876023308209280:12345-0@lo:502: Request processed in 335us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.834346:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789115355.834484:0:7928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7928:1876023308209280:0@lo:502: 00000100:00100000:0.0:1789115355.834566:0:7928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7928:1876023308209408:0@lo:502: 00000100:00100000:0.0:1789115355.834612:0:7928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115355.834638:0:7928:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789115355.835006:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308209408 00000100:00100000:2.0:1789115355.835013:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308209408 00000100:00100000:2.0:1789115355.835056:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789115355.835064:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+14:7928:x1876023308209408:12345-0@lo:502: 00000100:00100000:2.0:1789115355.835536:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+14:7928:x1876023308209408:12345-0@lo:502: Request processed in 471us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.835546:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789115355.835812:0:7928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7928:1876023308209408:0@lo:502: 00000040:00080000:1.0:1789115355.835843:0:7928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789115355.835997:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789115355.836018:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789115355.836031:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3050 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.836043:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3050 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115355.836067:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789115355.836070:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789115355.836073:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789115355.836110:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.836117:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.836127:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115355.836318:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308209536:0@lo:101: 00000100:00100000:2.0:1789115355.836365:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115355.836541:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1158cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115355.836597:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308209536 00000100:00100000:0.0:1789115355.836612:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308209536 00000100:00100000:0.0:1789115355.836654:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789115355.836663:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308209536:12345-0@lo:101: 00010000:00010000:0.0:1789115355.836678:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115355.836797:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d305e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d3057 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115355.836826:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d305e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d3057 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115355.836837:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d305e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3057 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115355.836847:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f400, rc 0) 00000100:00100000:0.0:1789115355.840534:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308209536:12345-0@lo:101: Request processed in 3861us (4156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115355.840547:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789115355.843988:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308209536:0@lo:101: 00010000:00010000:2.0:1789115355.844027:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d305e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.844042:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d305e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115355.844141:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308209664:0@lo:501: 00000100:00100000:2.0:1789115355.844362:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115355.844476:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1158cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115355.846430:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308209664 00000100:00100000:0.0:1789115355.846446:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308209664 00000100:00100000:1.0:1789115355.846974:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789115355.846987:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308209664:12345-0@lo:501: 00000100:00100000:1.0:1789115355.847742:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308209664:12345-0@lo:501: Request processed in 755us (3377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115355.847752:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789115355.855559:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308209664:0@lo:501: 00000100:00100000:2.0:1789115355.855633:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308209792:0@lo:503: 00000100:00100000:2.0:1789115355.857824:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115355.857876:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1158cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115355.860491:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308209792 00000100:00100000:0.0:1789115355.860509:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308209792 00000100:00100000:0.0:1789115355.860587:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789115355.860599:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308209792:12345-0@lo:503: 00000100:00100000:0.0:1789115355.861015:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308209792:12345-0@lo:503: Request processed in 417us (3197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115355.861024:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789115355.861376:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308209792:0@lo:503: 00000100:00100000:0.0:1789115355.863673:0:7929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc331e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7929:1876023308209920:0@lo:502: 00000100:00100000:0.0:1789115355.863777:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115355.863864:0:7929:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115355.865527:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308209920 00000100:00100000:2.0:1789115355.865541:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308209920 00000100:00100000:2.0:1789115355.865597:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789115355.865608:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:7929:x1876023308209920:12345-0@lo:502: 00000100:00100000:2.0:1789115355.865948:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:7929:x1876023308209920:12345-0@lo:502: Request processed in 341us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.865957:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789115355.866173:0:7929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc331e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7929:1876023308209920:0@lo:502: 00000020:01000000:0.0:1789115355.866222:0:7929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789115355.866240:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115355.866243:0:7929:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789115355.866248:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789115355.866250:0:7929:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789115355.866282:0:7929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc331e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7929:1876023308210048:0@lo:502: 00000100:00100000:0.0:1789115355.866332:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115355.866371:0:7929:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115355.866608:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308210048 00000100:00100000:2.0:1789115355.866614:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308210048 00000100:00100000:2.0:1789115355.866652:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789115355.866660:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+15:7929:x1876023308210048:12345-0@lo:502: 00000100:00100000:2.0:1789115355.866823:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+15:7929:x1876023308210048:12345-0@lo:502: Request processed in 163us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.866830:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789115355.866974:0:7929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc331e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7929:1876023308210048:0@lo:502: 00000020:01000000:0.0:1789115355.866994:0:7929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789115355.866999:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115355.867000:0:7929:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789115355.867003:0:7929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1789115355.867172:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789115355.867192:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789115355.867213:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d305e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.867225:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d305e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115355.867360:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789115355.867363:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dfcc65aa800 from 30 10000000:01000000:2.0:1789115355.867367:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789115355.867447:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.867455:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.867465:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115355.867480:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308210176:0@lo:101: 00000100:00100000:2.0:1789115355.867518:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115355.867540:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115355.867621:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308210176 00000100:00100000:0.0:1789115355.867626:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308210176 00000100:00100000:0.0:1789115355.867654:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789115355.867663:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308210176:12345-0@lo:101: 00010000:00010000:0.0:1789115355.867675:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115355.867818:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d306c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d3065 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115355.867845:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d306c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d3065 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115355.867857:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d306c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3065 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115355.867866:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28ea00, rc 0) 00000100:00100000:0.0:1789115355.867918:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308210176:12345-0@lo:101: Request processed in 255us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115355.867924:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789115355.867997:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308210176:0@lo:101: 00010000:00010000:2.0:1789115355.868011:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d306c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.868019:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d306c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115355.868065:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308210304:0@lo:501: 00000100:00100000:2.0:1789115355.868090:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115355.868117:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115355.868164:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308210304 00000100:00100000:0.0:1789115355.868168:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308210304 00000100:00100000:0.0:1789115355.868436:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789115355.868447:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308210304:12345-0@lo:501: 00000100:00100000:0.0:1789115355.868704:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308210304:12345-0@lo:501: Request processed in 259us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115355.868712:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789115355.872846:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308210304:0@lo:501: 00000100:00100000:2.0:1789115355.872916:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308210432:0@lo:503: 00000100:00100000:2.0:1789115355.872986:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115355.873038:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789115355.873518:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308210432 00000100:00100000:1.0:1789115355.873526:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308210432 00000100:00100000:1.0:1789115355.873576:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789115355.873587:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308210432:12345-0@lo:503: 00000100:00100000:1.0:1789115355.873957:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308210432:12345-0@lo:503: Request processed in 371us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115355.873965:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789115355.876326:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308210432:0@lo:503: 00010000:00010000:3.0:1789115355.878257:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115355.888548:0:7931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc331e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7931:1876023308210560:0@lo:502: 00000100:00100000:0.0:1789115355.888645:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115355.888705:0:7931:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bf180 going to sleep for 11 seconds 00000100:00100000:2.0:1789115355.888831:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308210560 00000100:00100000:2.0:1789115355.888840:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308210560 00000100:00100000:2.0:1789115355.888904:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789115355.888916:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:7931:x1876023308210560:12345-0@lo:502: 00000100:00100000:2.0:1789115355.889182:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:7931:x1876023308210560:12345-0@lo:502: Request processed in 267us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.889190:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789115355.889463:0:7931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc331e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7931:1876023308210560:0@lo:502: 00000100:00100000:0.0:1789115355.889523:0:7931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc331e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7931:1876023308210688:0@lo:502: 00000100:00100000:0.0:1789115355.889563:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115355.889585:0:7931:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bf180 going to sleep for 11 seconds 00000100:00100000:2.0:1789115355.889635:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308210688 00000100:00100000:2.0:1789115355.889639:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308210688 00000100:00100000:2.0:1789115355.889672:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789115355.889679:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+16:7931:x1876023308210688:12345-0@lo:502: 00000100:00100000:2.0:1789115355.889833:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+16:7931:x1876023308210688:12345-0@lo:502: Request processed in 153us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.889842:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789115355.889989:0:7931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc331e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7931:1876023308210688:0@lo:502: 00000040:00080000:1.0:1789115355.890011:0:7931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789115355.890198:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789115355.890225:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789115355.890297:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d306c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.890309:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d306c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115355.890320:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789115355.890323:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dfcc65aa800 from 5 10000000:01000000:2.0:1789115355.890326:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789115355.890359:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.890367:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.890428:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115355.890443:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308210816:0@lo:101: 00000100:00100000:2.0:1789115355.890479:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115355.890498:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789115355.890564:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308210816 00000100:00100000:1.0:1789115355.890570:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308210816 00000100:00100000:1.0:1789115355.890602:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789115355.890610:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308210816:12345-0@lo:101: 00010000:00010000:1.0:1789115355.890623:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115355.890638:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcda95ca00/0xa47abda6516d307a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d3073 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115355.890663:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcda95ca00/0xa47abda6516d307a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d3073 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115355.890697:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcda95ca00/0xa47abda6516d307a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3073 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115355.890707:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcda95ca00, rc 0) 00000100:00100000:1.0:1789115355.890742:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308210816:12345-0@lo:101: Request processed in 133us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115355.890748:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789115355.890936:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308210816:0@lo:101: 00010000:00010000:2.0:1789115355.890950:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.890959:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115355.891007:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308210944:0@lo:256: 00000100:00100000:2.0:1789115355.891038:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115355.891100:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115355.893469:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308210944 00000100:00100000:0.0:1789115355.893484:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308210944 00000100:00100000:0.0:1789115355.893584:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789115355.893595:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308210944:12345-0@lo:256: 20000000:01000000:0.0:1789115355.893624:0:5843:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789115355.893647:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789115355.893649:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789115355.893800:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308210944:12345-0@lo:256: Request processed in 206us (2760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115355.893809:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789115355.893907:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308210944:0@lo:256: 10000000:01000000:2.0:1789115355.893961:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789115355.893972:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.893982:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115355.893991:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789115355.893995:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789115355.894002:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789115355.894040:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.894048:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.894057:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115355.894075:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308211072:0@lo:101: 00000100:00100000:2.0:1789115355.894111:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115355.900863:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789115355.900978:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308211072 00000100:00100000:1.0:1789115355.900989:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308211072 00000100:00100000:1.0:1789115355.901045:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789115355.901056:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308211072:12345-0@lo:101: 00010000:00010000:1.0:1789115355.901078:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115355.901101:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcda95c400/0xa47abda6516d3088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d3081 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115355.901136:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcda95c400/0xa47abda6516d3088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d3081 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115355.901149:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcda95c400/0xa47abda6516d3088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3081 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115355.901162:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcda95c400, rc 0) 00000100:00100000:1.0:1789115355.901239:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308211072:12345-0@lo:101: Request processed in 184us (7127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115355.901247:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789115355.904400:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308211072:0@lo:101: 00010000:00010000:2.0:1789115355.904437:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3088 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115355.904451:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3088 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115355.904548:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308211200:0@lo:501: 00000100:00100000:2.0:1789115355.904616:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115355.904655:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789115355.904671:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308211200 00000100:00100000:2.0:1789115355.904677:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308211200 00000100:00100000:2.0:1789115355.904730:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789115355.904739:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308211200:12345-0@lo:501: 00000100:00100000:2.0:1789115355.905014:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308211200:12345-0@lo:501: Request processed in 274us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.905033:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789115355.905073:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308211200:0@lo:501: 00000100:00100000:2.0:1789115355.905102:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308211328:0@lo:503: 00000100:00100000:2.0:1789115355.905142:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115355.905155:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789115355.905167:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308211328 00000100:00100000:2.0:1789115355.905170:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308211328 00000100:00100000:2.0:1789115355.905191:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789115355.905197:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308211328:12345-0@lo:503: 00000100:00100000:2.0:1789115355.905517:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308211328:12345-0@lo:503: Request processed in 319us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.905524:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789115355.905563:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308211328:0@lo:503: 00000100:00100000:0.0:1789115355.907268:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc331e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7933:1876023308211456:0@lo:502: 00000100:00100000:0.0:1789115355.907352:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115355.907407:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bf180 going to sleep for 11 seconds 00000100:00100000:2.0:1789115355.907478:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308211456 00000100:00100000:2.0:1789115355.907487:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308211456 00000100:00100000:2.0:1789115355.907541:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789115355.907552:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:7933:x1876023308211456:12345-0@lo:502: 00000100:00100000:2.0:1789115355.908014:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:7933:x1876023308211456:12345-0@lo:502: Request processed in 464us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.908023:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789115355.908132:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc331e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7933:1876023308211456:0@lo:502: 00000020:01000000:0.0:1789115355.908161:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789115355.908169:0:7933:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789115355.908176:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115355.908178:0:7933:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789115355.908182:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789115355.908186:0:7933:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:0.0:1789115355.908218:0:7933:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789115355.908222:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789115355.908237:0:7933:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dfcfbfc1a48) 00000020:00000080:0.0:1789115355.908256:0:7933:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789115355.908261:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789115355.908352:0:7933:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789115355.908359:0:7933:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789115355.908367:0:7933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa47abda6516d3096 00010000:00080000:0.0:1789115355.908435:0:7933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dfbc1365000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1789115355.908680:0:7933:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1789115355.909085:0:7933:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789115355.909098:0:7933:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789115355.909660:0:7933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789115355.910165:0:7933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789115355.910233:0:7933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789115355.910326:0:7933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789115355.914372:0:7934:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789115355.914399:0:7934:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789115355.916524:0:7933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789115355.916540:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789115355.916589:0:7933:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789115355.916613:0:7933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa47abda6516d309d 00000100:00080000:1.0:1789115355.916626:0:7933:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789115355.916634:0:7933:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dfbc1365000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1789115355.916676:0:7933:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfcf50f2940 x1876023308211584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789115355.916823:0:7933:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1789115355.916921:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308211840:0@lo:400: 00000100:00100000:1.0:1789115355.916987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115355.917027:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789115355.917033:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308211712:0@lo:400: 00000100:00100000:1.0:1789115355.917057:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115355.917084:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308212096:0@lo:400: 00000100:00100000:1.0:1789115355.917108:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115355.917126:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789115355.917132:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308211968:0@lo:400: 00000100:00100000:1.0:1789115355.917156:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115355.917185:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308211840 00000100:00100000:1.0:1789115355.917192:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308211840 00000100:00100000:1.0:1789115355.917241:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308211712 00000100:00100000:1.0:1789115355.917244:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308211712 00000100:00100000:1.0:1789115355.917256:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308212096 00000100:00100000:1.0:1789115355.917258:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308212096 00000100:00100000:1.0:1789115355.917272:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789115355.917282:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308211840:12345-0@lo:400: 00000100:00100000:1.0:1789115355.917340:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308211840:12345-0@lo:400: Request processed in 59us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115355.917348:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789115355.917375:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789115355.917404:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308211712:12345-0@lo:400: 00000100:00100000:1.0:1789115355.917436:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308211712:12345-0@lo:400: Request processed in 56us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115355.917442:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789115355.917454:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789115355.917460:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308212096:12345-0@lo:400: 00000100:00100000:1.0:1789115355.917489:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308212096:12345-0@lo:400: Request processed in 29us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115355.917495:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789115355.917519:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308211968 00000100:00100000:1.0:1789115355.917522:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308211968 00000100:00100000:1.0:1789115355.917546:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789115355.917551:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308211968:12345-0@lo:400: 00000100:00100000:1.0:1789115355.917579:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308211968:12345-0@lo:400: Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115355.917585:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789115355.917623:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f3c00 x1876023308211968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115355.917637:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308211968:0@lo:400: 00010000:00080000:1.0:1789115355.917651:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f1680 x1876023308212096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115355.917659:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308212096:0@lo:400: 00000100:00100000:2.0:1789115355.917798:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308211584:0@lo:8: 00010000:00080000:1.0:1789115355.917833:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f0780 x1876023308211712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115355.917856:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308211712:0@lo:400: 00000100:00100000:2.0:1789115355.920502:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115355.920574:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308211584 00000100:00100000:2.0:1789115355.920593:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308211584 00000100:00100000:2.0:1789115355.920631:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789115355.920641:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd3420780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1876023308211584:12345-0@lo:8: 00010000:00080000:2.0:1789115355.920677:0:6699:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00010000:00080000:1.0:1789115355.920824:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f2580 x1876023308211840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115355.920840:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308211840:0@lo:400: 00000020:01000000:1.0:1789115355.920991:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115355.920998:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115355.921000:0:7933:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789115355.921004:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115355.921008:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115355.921009:0:7933:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789115355.921012:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789115355.921014:0:7933:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789115355.921050:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7933:1876023308212224:0@lo:502: 00000100:00100000:1.0:1789115355.921102:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115355.921131:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308212224 00000100:00100000:1.0:1789115355.921135:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308212224 00000100:00100000:1.0:1789115355.921167:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789115355.921174:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+18:7933:x1876023308212224:12345-0@lo:502: 00000100:00100000:1.0:1789115355.921452:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+18:7933:x1876023308212224:12345-0@lo:502: Request processed in 278us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115355.921461:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789115355.921514:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1241d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789115355.921529:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:7933:1876023308212224:0@lo:502: 00000020:01000000:1.0:1789115355.921551:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115355.921556:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115355.921558:0:7933:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789115355.921567:0:7933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:00000080:2.0:1789115355.925301:0:6699:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa47abda6516d30a4 00002000:00100000:2.0:1789115355.925327:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dfcfbf90000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398e ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789115355.925333:0:6699:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789115355.925339:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789115355.925486:0:6699:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789115355.925661:0:6699:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789115355.925714:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8dfcfbf97800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789115355.925810:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd3420780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876023308211584:12345-0@lo:8: Request processed in 5169us (5315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115355.925821:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789115355.925904:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f2940 x1876023308211584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789115365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115355.925917:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789115355.925927:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789115355.925935:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789115355.925941:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789115355.925944:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfbc1365000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000020:01000000:1.0:1789115355.926063:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789115355.926088:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789115355.926100:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3088 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115355.926110:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3088 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115355.926121:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789115355.926124:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dfcd92d3490 from 1 10000000:01000000:1.0:1789115355.926128:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789115355.926167:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115355.926174:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115355.926184:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115355.926214:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308212352:0@lo:101: 00000100:00100000:1.0:1789115355.926257:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115355.926293:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1241d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789115355.926310:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308212352 00000100:00100000:1.0:1789115355.926317:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308212352 00000100:00100000:1.0:1789115355.926357:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789115355.926366:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308212352:12345-0@lo:101: 00010000:00010000:1.0:1789115355.926376:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115355.926408:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d30b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d30ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115355.926448:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d30b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d30ab expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115355.926460:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d30b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d30ab expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115355.926469:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcda95d400, rc 0) 00000100:00100000:1.0:1789115355.926500:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308212352:12345-0@lo:101: Request processed in 135us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115355.926506:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789115355.926543:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308212352:0@lo:101: 00010000:00010000:1.0:1789115355.926560:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d30b2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115355.926569:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d30b2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115355.926619:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308212480:0@lo:501: 00000100:00100000:1.0:1789115355.926644:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115355.926657:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1241d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789115355.926669:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308212480 00000100:00100000:1.0:1789115355.926672:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308212480 00000100:00100000:1.0:1789115355.926692:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789115355.926698:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308212480:12345-0@lo:501: 00000100:00100000:1.0:1789115355.926918:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308212480:12345-0@lo:501: Request processed in 219us (273us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789115355.926925:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789115355.926964:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308212480:0@lo:501: 10000000:01000000:1.0:1789115355.926986:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789115355.926991:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d30b2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115355.926999:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d30b2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789115355.932256:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789115355.932276:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308211584:0@lo:8: 00000004:00080000:2.0:1789115355.932324:0:7934:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789115355.932481:0:7934:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 173145097931ns, next at 0ns, rc = 0 00000004:00080000:1.0:1789115356.009779:0:7935:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789115356.009813:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f0780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1876023308212736:0@lo:7: 00000100:00100000:1.0:1789115356.009889:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115356.009937:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411300 going to sleep for 11 seconds 00000100:00100000:1.0:1789115356.009952:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789115356.009966:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308212608:0@lo:13: 00000100:00100000:1.0:1789115356.009993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115356.010025:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308212736 00000100:00100000:1.0:1789115356.010033:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308212736 00000100:00100000:1.0:1789115356.010093:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789115356.010102:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7935:x1876023308212736:12345-0@lo:7: 00000004:00080000:2.0:1789115356.013335:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789115356.014031:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308212608 00000100:00100000:3.0:1789115356.014045:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308212608 00000100:00100000:3.0:1789115356.014116:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789115356.014128:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876023308212608:12345-0@lo:13: 00002000:00000024:3.0:1789115356.014167:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789115356.014280:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876023308212608:12345-0@lo:13: Request processed in 154us (4285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115356.014288:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789115356.014317:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789115356.015867:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f2580 x1876023308212608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115356.015895:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308212608:0@lo:13: 00002000:00080000:1.0:1789115356.021879:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789115356.021888:0:6697:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789115356.021999:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7935:x1876023308212736:12345-0@lo:7: Request processed in 11891us (12104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115356.022011:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789115356.022269:0:7935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f0780 x1876023308212736/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789115372 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115356.022287:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f0780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1876023308212736:0@lo:7: 00000004:00080000:3.0:1789115356.022304:0:7935:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789115356.022353:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1876023308212864:0@lo:5: 00000100:00100000:3.0:1789115356.022438:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115356.022473:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789115356.024286:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308212864 00000100:00100000:1.0:1789115356.024299:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308212864 00000100:00100000:1.0:1789115356.024415:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789115356.024427:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7935:x1876023308212864:12345-0@lo:5: 00002000:00080000:1.0:1789115356.024474:0:6699:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789115356.024479:0:6699:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789115356.024910:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7935:x1876023308212864:12345-0@lo:5: Request processed in 485us (2470us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789115356.024918:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789115356.032534:0:7935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50e83c0 x1876023308212864/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789115372 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115356.032567:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1876023308212864:0@lo:5: 00000004:00080000:2.0:1789115356.032585:0:7935:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789115356.032654:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf86d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1876023308212992:0@lo:700: 00000100:00100000:2.0:1789115356.032737:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115356.032784:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136b900 going to sleep for 11 seconds 00000100:00100000:2.0:1789115356.032811:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308212992 00000100:00100000:2.0:1789115356.032818:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308212992 00000100:00100000:2.0:1789115356.032881:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789115356.032891:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7935:x1876023308212992:12345-0@lo:700: 00000100:00100000:2.0:1789115356.032934:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf843c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6705:1876023308213120:0@lo:700: 00000100:00100000:2.0:1789115356.032963:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115356.032979:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789115356.032993:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308213120 00000100:00100000:2.0:1789115356.032996:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308213120 00000100:00100000:2.0:1789115356.033022:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789115356.033029:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6705:x1876023308213120:12345-0@lo:700: 40000000:02000000:2.0:1789115356.136415:0:5857:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1789115356.145415:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6705:x1876023308213120:12345-0@lo:700: Request processed in 112378us (112442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115356.145439:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789115356.145694:0:6705:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf843c0 x1876023308213120/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789115372 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115356.145712:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf843c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6705:1876023308213120:0@lo:700: 40000000:02000000:2.0:1789115356.145726:0:6705:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1789115356.272354:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7935:x1876023308212992:12345-0@lo:700: Request processed in 239455us (239608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115356.272372:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789115356.272516:0:7935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf86d00 x1876023308212992/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789115372 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115356.272559:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf86d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1876023308212992:0@lo:700: 00000001:00080000:1.0:1789115356.280057:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1789115356.280091:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:2.0:1789115356.364872:0:7935:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1789115356.371181:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f12c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1876023308213248:0@lo:5: 00000100:00100000:1.0:1789115356.371270:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115356.371372:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115356.375436:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308213248 00000100:00100000:0.0:1789115356.375450:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308213248 00000100:00100000:0.0:1789115356.376949:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789115356.376973:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7935:x1876023308213248:12345-0@lo:5: 00002000:00080000:3.0:1789115356.387719:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789115356.387823:0:6698:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789115356.395551:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7935:x1876023308213248:12345-0@lo:5: Request processed in 18581us (24272us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789115356.395567:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789115356.396899:0:7935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f12c0 x1876023308213248/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789115372 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115356.396918:0:7935:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789115356.396937:0:7935:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dfcf50f12c0 x1876023308213248/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789115372 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115356.396948:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f12c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1876023308213248:0@lo:5: 00000004:00080000:0.0:1789115356.396965:0:7935:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:3.0:1789115356.609101:0:7991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789115356.905890:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115357.926022:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115358.954901:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115359.915540:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308213376:0@lo:13: 00000100:00100000:1.0:1789115359.915626:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115359.915919:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308213376 00000100:00100000:3.0:1789115359.915927:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308213376 00000100:00100000:3.0:1789115359.915999:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789115359.916011:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308213376:12345-0@lo:13: 00002000:00000024:3.0:1789115359.916055:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115359.916108:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308213376:12345-0@lo:13: Request processed in 101us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115359.916115:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789115359.916139:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789115359.916170:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f0b40 x1876023308213376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115359.916200:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308213376:0@lo:13: 00010000:00010000:1.0:1789115359.972064:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115360.935706:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308213632:0@lo:400: 00000100:00100000:2.0:1789115360.935810:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115360.935880:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308214144:0@lo:400: 00000100:00100000:2.0:1789115360.935911:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115360.935945:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789115360.935952:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308213504:0@lo:400: 00000100:00100000:2.0:1789115360.935986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115360.936020:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308214016:0@lo:400: 00000100:00100000:2.0:1789115360.936044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115360.936073:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308213760:0@lo:400: 00000100:00100000:2.0:1789115360.936097:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115360.936116:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789115360.936122:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308213888:0@lo:400: 00000100:00100000:2.0:1789115360.936145:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115360.936186:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308213632 00000100:00100000:2.0:1789115360.936194:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308213632 00000100:00100000:2.0:1789115360.936235:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308214016 00000100:00100000:2.0:1789115360.936238:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308214016 00000100:00100000:2.0:1789115360.936262:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308213760 00000100:00100000:2.0:1789115360.936266:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308213760 00000100:00100000:2.0:1789115360.936284:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789115360.936292:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308213632:12345-0@lo:400: 00000100:00100000:2.0:1789115360.936346:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308213632:12345-0@lo:400: Request processed in 54us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115360.936362:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789115360.936413:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789115360.936420:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308214016:12345-0@lo:400: 00000100:00100000:2.0:1789115360.936449:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308214016:12345-0@lo:400: Request processed in 30us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115360.936455:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789115360.936467:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789115360.936473:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308213760:12345-0@lo:400: 00000100:00100000:2.0:1789115360.936505:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308213760:12345-0@lo:400: Request processed in 33us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115360.936512:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789115360.936540:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308214144 00000100:00100000:2.0:1789115360.936544:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308214144 00000100:00100000:2.0:1789115360.936571:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308213888 00000100:00100000:2.0:1789115360.936573:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308213888 00000100:00100000:2.0:1789115360.936592:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789115360.936599:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876023308214144:12345-0@lo:400: 00000100:00100000:2.0:1789115360.936631:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876023308214144:12345-0@lo:400: Request processed in 32us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115360.936637:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789115360.936647:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789115360.936653:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308213888:12345-0@lo:400: 00000100:00100000:2.0:1789115360.936679:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308213888:12345-0@lo:400: Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115360.936684:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789115360.936718:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf84780 x1876023308213888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115360.936741:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308213888:0@lo:400: 00010000:00080000:2.0:1789115360.936754:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf86940 x1876023308213760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115360.936762:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308213760:0@lo:400: 00010000:00080000:2.0:1789115360.936796:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf86580 x1876023308214016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115360.936804:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308214016:0@lo:400: 00010000:00080000:2.0:1789115360.936814:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf85a40 x1876023308213632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115360.936822:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308213632:0@lo:400: 00010000:00080000:2.0:1789115360.936832:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf87c00 x1876023308214144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115360.936841:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308214144:0@lo:400: 00000100:00100000:0.0:1789115360.937273:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308213504 00000100:00100000:0.0:1789115360.937281:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308213504 00000100:00100000:0.0:1789115360.937320:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789115360.937326:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308213504:12345-0@lo:400: 00000100:00100000:0.0:1789115360.937377:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308213504:12345-0@lo:400: Request processed in 52us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115360.937398:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1789115360.939103:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789115360.939118:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115360.939199:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308213504:0@lo:400: 00010000:00010000:3.0:1789115360.996079:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115361.444750:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789115361.444782:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308214272:0@lo:13: 00000100:00100000:1.0:1789115361.444867:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115361.445896:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308214272 00000100:00100000:3.0:1789115361.445911:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308214272 00000100:00100000:3.0:1789115361.445969:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789115361.445978:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308214272:12345-0@lo:13: 00002000:00000024:3.0:1789115361.446019:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115361.446110:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308214272:12345-0@lo:13: Request processed in 134us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115361.446118:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789115361.446179:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f0780 x1876023308214272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115361.446201:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308214272:0@lo:13: 00000001:00080000:3.0:1789115361.564447:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1789115362.020065:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115362.825150:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115362.825423:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288266880 00000100:00100000:1.0:1789115362.825444:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288266880 00000100:00100000:1.0:1789115362.825485:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:1.0:1789115362.825494:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2349:x1876023288266880:12345-192.168.203.31@tcp:250: 00010000:00080000:1.0:1789115362.825524:0:5846:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 7b938f65-f46e-46d5-8ccc-96c5e68593dd@192.168.203.31@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:1.0:1789115362.825559:0:5846:0:(genops.c:1385:class_connect()) connect: client 7b938f65-f46e-46d5-8ccc-96c5e68593dd, cookie 0xa47abda6516d30b9 00000100:00080000:1.0:1789115362.825881:0:5846:0:(import.c:65:import_set_state_nolock()) ffff8dfcffb03000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789115362.825950:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+5:2349:x1876023288266880:12345-192.168.203.31@tcp:250: Request processed in 455us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115362.825959:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:2.0:1789115362.833210:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115362.834198:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288267008 00000100:00100000:0.0:1789115362.834210:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288267008 00000100:00100000:0.0:1789115362.834278:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:0.0:1789115362.834287:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+5:5579:x1876023288267008:12345-192.168.203.31@tcp:101: 00010000:00010000:0.0:1789115362.834306:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115362.834324:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d30c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa39ab expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115362.834370:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d30c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39ab expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115362.837251:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d30c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39ab expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115362.837291:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e400, rc 0) 00000100:00100000:0.0:1789115362.837422:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+6:5579:x1876023288267008:12345-192.168.203.31@tcp:101: Request processed in 3133us (4224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115362.837442:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:0.0:1789115362.840326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115362.841657:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288267136 00000100:00100000:2.0:1789115362.841677:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288267136 00000100:00100000:2.0:1789115362.842594:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:2.0:1789115362.842614:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+6:5579:x1876023288267136:12345-192.168.203.31@tcp:501: 00000100:00100000:2.0:1789115362.843086:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+6:5579:x1876023288267136:12345-192.168.203.31@tcp:501: Request processed in 478us (2771us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789115362.843104:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:0.0:1789115362.847246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115362.852678:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288267264 00000100:00100000:3.0:1789115362.852699:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288267264 00000100:00100000:3.0:1789115362.852789:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:3.0:1789115362.852800:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+6:5579:x1876023288267264:12345-192.168.203.31@tcp:101: 00010000:00010000:3.0:1789115362.852820:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115362.852842:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d30c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa39b2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115362.852872:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d30c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39b2 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115362.852883:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d30c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39b2 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115362.852914:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c4800, rc 0) 00000100:00100000:3.0:1789115362.853012:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+7:5579:x1876023288267264:12345-192.168.203.31@tcp:101: Request processed in 214us (5780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115362.853020:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:1.0:1789115362.859524:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115362.859960:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288267392 00000100:00100000:3.0:1789115362.859970:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288267392 00000100:00100000:3.0:1789115362.860036:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:3.0:1789115362.860046:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+7:5579:x1876023288267392:12345-192.168.203.31@tcp:501: 00000100:00100000:3.0:1789115362.860728:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+8:5579:x1876023288267392:12345-192.168.203.31@tcp:501: Request processed in 678us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115362.860740:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:2.0:1789115362.879599:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115362.879821:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288267520 00000100:00100000:1.0:1789115362.879832:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288267520 00000100:00100000:1.0:1789115362.879896:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:1.0:1789115362.879907:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+8:5579:x1876023288267520:12345-192.168.203.31@tcp:503: 00000100:00100000:1.0:1789115362.880420:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+8:5579:x1876023288267520:12345-192.168.203.31@tcp:503: Request processed in 512us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115362.880494:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:1.0:1789115362.889495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115362.891357:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288267648 00000100:00100000:0.0:1789115362.891378:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288267648 00000100:00100000:0.0:1789115362.891506:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:0.0:1789115362.891516:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+8:5598:x1876023288267648:12345-192.168.203.31@tcp:502: 00000100:00100000:0.0:1789115362.891960:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+8:5598:x1876023288267648:12345-192.168.203.31@tcp:502: Request processed in 444us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115362.891970:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:2.0:1789115362.935949:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115362.936069:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288267776 00000100:00100000:3.0:1789115362.936088:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288267776 00000100:00100000:3.0:1789115362.936166:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:3.0:1789115362.936178:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+8:5598:x1876023288267776:12345-192.168.203.31@tcp:502: 00000100:00100000:3.0:1789115362.936577:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+8:5598:x1876023288267776:12345-192.168.203.31@tcp:502: Request processed in 401us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115362.936587:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:2.0:1789115362.942991:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115362.945483:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288267904 00000100:00100000:1.0:1789115362.945502:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288267904 00000100:00100000:1.0:1789115362.945587:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:1.0:1789115362.945600:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+8:5579:x1876023288267904:12345-192.168.203.31@tcp:101: 00010000:00010000:1.0:1789115362.945621:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115362.945652:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcda95da00/0xa47abda6516d30ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa39dc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115362.945684:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcda95da00/0xa47abda6516d30ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39dc expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115362.945696:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcda95da00/0xa47abda6516d30ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39dc expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115362.945706:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcda95da00, rc 0) 00000100:00100000:1.0:1789115362.945793:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:5579:x1876023288267904:12345-192.168.203.31@tcp:101: Request processed in 196us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115362.945801:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:1.0:1789115362.955114:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115362.955353:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288268032 00000100:00100000:0.0:1789115362.955366:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288268032 00000100:00100000:0.0:1789115362.955445:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:0.0:1789115362.955456:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:5579:x1876023288268032:12345-192.168.203.31@tcp:256: 20000000:01000000:0.0:1789115362.955488:0:5843:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789115362.955503:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789115362.955507:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789115362.955513:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789115362.955516:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789115362.967671:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:5579:x1876023288268032:12345-192.168.203.31@tcp:256: Request processed in 12205us (12556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115362.967687:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:2.0:1789115362.972206:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115362.972318:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288268160 00000100:00100000:3.0:1789115362.972333:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288268160 00000100:00100000:3.0:1789115362.972475:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:3.0:1789115362.972486:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:5579:x1876023288268160:12345-192.168.203.31@tcp:101: 00010000:00010000:3.0:1789115362.972505:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115362.972527:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d30d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa39e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115362.972581:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d30d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39e3 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115362.972593:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d30d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39e3 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115362.972603:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c4c00, rc 0) 00000100:00100000:3.0:1789115362.972684:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5579:x1876023288268160:12345-192.168.203.31@tcp:101: Request processed in 200us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115362.972692:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:1.0:1789115362.983657:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115362.983782:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288268288 00000100:00100000:0.0:1789115362.983797:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288268288 00000100:00100000:0.0:1789115362.983865:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:0.0:1789115362.983877:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5579:x1876023288268288:12345-192.168.203.31@tcp:501: 00000100:00100000:0.0:1789115362.984261:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5579:x1876023288268288:12345-192.168.203.31@tcp:501: Request processed in 385us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115362.984269:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:2.0:1789115362.990429:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115362.990587:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288268416 00000100:00100000:1.0:1789115362.990599:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288268416 00000100:00100000:1.0:1789115362.990670:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:1.0:1789115362.990682:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5579:x1876023288268416:12345-192.168.203.31@tcp:503: 00000100:00100000:1.0:1789115362.991097:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5579:x1876023288268416:12345-192.168.203.31@tcp:503: Request processed in 415us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115362.991106:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:2.0:1789115362.996142:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115362.998617:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288268544 00000100:00100000:3.0:1789115362.998635:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288268544 00000100:00100000:3.0:1789115362.998730:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:3.0:1789115362.998741:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5602:x1876023288268544:12345-192.168.203.31@tcp:502: 00000100:00100000:3.0:1789115363.000283:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5602:x1876023288268544:12345-192.168.203.31@tcp:502: Request processed in 1530us (4141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115363.000298:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:2.0:1789115363.006296:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115363.006456:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288268672 00000100:00100000:0.0:1789115363.006466:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288268672 00000100:00100000:0.0:1789115363.006520:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:0.0:1789115363.006530:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5602:x1876023288268672:12345-192.168.203.31@tcp:502: 00000100:00100000:0.0:1789115363.006848:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5602:x1876023288268672:12345-192.168.203.31@tcp:502: Request processed in 318us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115363.006857:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:2.0:1789115363.013206:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115363.013497:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288268800 00000100:00100000:1.0:1789115363.013509:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288268800 00000100:00100000:1.0:1789115363.013568:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1789115363.013577:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2349:x1876023288268800:12345-192.168.203.31@tcp:38: 00010000:00080000:1.0:1789115363.013615:0:5851:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:1.0:1789115363.013680:0:5851:0:(genops.c:1385:class_connect()) connect: client 6dbf7574-92fb-4b89-af78-41319f924699, cookie 0xa47abda6516d30dc 00000004:00100000:1.0:1789115363.013716:0:5851:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:1.0:1789115363.013724:0:5851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1789115363.049001:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789115363.068845:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8dfcc4f4a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789115363.068943:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+6:2349:x1876023288268800:12345-192.168.203.31@tcp:38: Request processed in 55364us (55748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115363.068956:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1789115363.577593:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115363.577695:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115363.577968:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288269056 00000100:00100000:3.0:1789115363.577980:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288269056 00000100:00100000:3.0:1789115363.578082:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288268928 00000100:00100000:3.0:1789115363.578087:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288268928 00000100:00100000:3.0:1789115363.578108:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1789115363.578119:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+7:5579:x1876023288269056:12345-192.168.203.31@tcp:41: 00000004:00000024:3.0:1789115363.578197:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789115363.578283:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+7:5579:x1876023288269056:12345-192.168.203.31@tcp:41: Request processed in 162us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115363.578319:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1789115363.578348:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1789115363.578359:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:0:x1876023288268928:12345-192.168.203.31@tcp:41: 00000004:00000024:3.0:1789115363.578371:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789115363.578428:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:0:x1876023288268928:12345-192.168.203.31@tcp:41: Request processed in 72us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115363.578435:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00080000:2.0:1789115363.579558:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115363.590045:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115363.590231:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288269184 00000100:00100000:3.0:1789115363.590242:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288269184 00000100:00100000:3.0:1789115363.590311:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1789115363.590323:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:5579:x1876023288269184:12345-192.168.203.31@tcp:40: 00000100:00100000:3.0:1789115363.590467:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:5579:x1876023288269184:12345-192.168.203.31@tcp:40: Request processed in 146us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115363.590476:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1789115363.611507:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115363.611778:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115363.611823:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115363.611863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115363.611937:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288269568 00000100:00100000:3.0:1789115363.611947:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288269568 00000100:00100000:3.0:1789115363.611994:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1789115363.612004:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:5579:x1876023288269568:12345-192.168.203.31@tcp:33: 00000100:00100000:0.0:1789115363.612799:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288269696 00000100:00100000:0.0:1789115363.612809:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288269696 00000100:00100000:0.0:1789115363.612851:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:0.0:1789115363.612859:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288269696:12345-192.168.203.31@tcp:400: 00000100:00100000:0.0:1789115363.612946:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288269696:12345-192.168.203.31@tcp:400: Request processed in 87us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115363.612956:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:1.0:1789115363.631574:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288269312 00000100:00100000:1.0:1789115363.631590:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288269312 00000100:00100000:1.0:1789115363.631863:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288269440 00000100:00100000:1.0:1789115363.631869:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288269440 00000100:00100000:3.0:1789115363.632065:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1789115363.632076:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1876023288269312:12345-192.168.203.31@tcp:8: 00010000:00080000:3.0:1789115363.632117:0:6885:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:3.0:1789115363.632171:0:6885:0:(genops.c:1385:class_connect()) connect: client 6dbf7574-92fb-4b89-af78-41319f924699, cookie 0xa47abda6516d30e3 00002000:00100000:3.0:1789115363.632184:0:6885:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6dbf7574-92fb-4b89-af78-41319f924699/ffff8dfcc5deb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789115363.632234:0:6885:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1789115363.632663:0:6885:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789115363.632721:0:6885:0:(import.c:65:import_set_state_nolock()) ffff8dfcc5dee000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789115363.632812:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2349:x1876023288269312:12345-192.168.203.31@tcp:8: Request processed in 734us (21320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115363.632821:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1789115363.632845:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1789115363.632849:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1876023288269440:12345-192.168.203.31@tcp:8: 00010000:00080000:3.0:1789115363.632869:0:6885:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:3.0:1789115363.632889:0:6885:0:(genops.c:1385:class_connect()) connect: client 6dbf7574-92fb-4b89-af78-41319f924699, cookie 0xa47abda6516d30ea 00002000:00100000:3.0:1789115363.632895:0:6885:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6dbf7574-92fb-4b89-af78-41319f924699/ffff8dfcc5def800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789115363.632912:0:6885:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1789115363.633127:0:6885:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789115363.633143:0:6885:0:(import.c:65:import_set_state_nolock()) ffff8dfcc5def000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789115363.633182:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2349:x1876023288269440:12345-192.168.203.31@tcp:8: Request processed in 331us (21318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115363.633189:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000004:00080000:1.0:1789115363.642942:0:5853:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30855us 00000004:00200000:0.0:1789115363.682626:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1789115363.682842:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:5579:x1876023288269568:12345-192.168.203.31@tcp:33: Request processed in 70830us (71055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115363.682860:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:2.0:1789115363.890882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115363.890972:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288269824 00000100:00100000:0.0:1789115363.890983:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288269824 00000100:00100000:0.0:1789115363.891054:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1789115363.891065:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+6:5619:x1876023288269824:12345-192.168.203.31@tcp:101: 00010000:00010000:0.0:1789115363.891164:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115363.891236:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d30f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3a0d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115363.891321:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d30f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115363.891336:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d30f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115363.891353:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d30f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115363.891839:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789115363.891851:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115363.891975:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d30f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115363.892023:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d30f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a0d expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115363.892056:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d30f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a0d expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115363.892066:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044fa00) 00010000:00010000:1.0:1789115363.892069:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789115363.892072:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f200, rc 0) 00000100:00100000:1.0:1789115363.892176:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+7:5619:x1876023288269824:12345-192.168.203.31@tcp:101: Request processed in 1111us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115363.892185:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00010000:00010000:3.0:1789115364.068801:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115365.028177:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308214400:0@lo:13: 00000100:00100000:3.0:1789115365.028254:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115365.029660:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308214400 00000100:00100000:1.0:1789115365.029674:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308214400 00000100:00100000:1.0:1789115365.029746:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789115365.029758:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308214400:12345-0@lo:13: 00002000:00000024:1.0:1789115365.029800:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115365.029889:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308214400:12345-0@lo:13: Request processed in 134us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115365.029898:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789115365.033426:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789115365.033646:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f30c0 x1876023308214400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115365.033677:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308214400:0@lo:13: 00010000:00010000:3.0:1789115365.102288:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789115365.102518:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6dbf7574-92fb-4b89-af78-41319f924699 00000100:00100000:1.0:1789115365.995935:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115365.996053:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288269952 00000100:00100000:3.0:1789115365.996066:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288269952 00000100:00100000:3.0:1789115365.996179:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1789115365.996206:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:5671:x1876023288269952:12345-192.168.203.31@tcp:41: 00000004:00000024:3.0:1789115365.996260:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789115365.996334:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:5671:x1876023288269952:12345-192.168.203.31@tcp:41: Request processed in 131us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115365.996342:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00080000:0.0:1789115365.996915:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115366.009536:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115366.009640:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288270080 00000100:00100000:1.0:1789115366.009654:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288270080 00000100:00100000:1.0:1789115366.009749:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:1.0:1789115366.009761:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6dbf7574-92fb-4b89-af78-41319f924699+5:5671:x1876023288270080:12345-192.168.203.31@tcp:13: 00002000:00000024:1.0:1789115366.009795:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115366.009883:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6dbf7574-92fb-4b89-af78-41319f924699+5:5671:x1876023288270080:12345-192.168.203.31@tcp:13: Request processed in 124us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115366.009908:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00080000:0.0:1789115366.010447:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789115366.014817:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115366.014971:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288270208 00000100:00100000:1.0:1789115366.014983:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288270208 00000100:00100000:1.0:1789115366.015060:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1789115366.015072:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6dbf7574-92fb-4b89-af78-41319f924699+6:5671:x1876023288270208:12345-192.168.203.31@tcp:13: 00002000:00000024:1.0:1789115366.015120:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115366.015200:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6dbf7574-92fb-4b89-af78-41319f924699+6:5671:x1876023288270208:12345-192.168.203.31@tcp:13: Request processed in 130us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115366.015221:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00080000:0.0:1789115366.015686:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789115366.051728:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308214784:0@lo:400: 00000100:00100000:3.0:1789115366.051807:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115366.051872:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115366.051877:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308214912:0@lo:400: 00000100:00100000:3.0:1789115366.051905:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115366.051945:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308214912 00000100:00100000:3.0:1789115366.051954:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308214912 00000100:00100000:3.0:1789115366.052008:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789115366.052020:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308214912:12345-0@lo:400: 00000100:00100000:3.0:1789115366.052077:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308214912:12345-0@lo:400: Request processed in 59us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115366.052085:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789115366.052151:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50eb840 x1876023308214912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115366.052166:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308214912:0@lo:400: 00000100:00100000:2.0:1789115366.052473:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308214656:0@lo:400: 00000100:00100000:2.0:1789115366.052508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115366.052536:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308215168:0@lo:400: 00000100:00100000:2.0:1789115366.052580:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115366.052606:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789115366.052612:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308214528:0@lo:400: 00000100:00100000:2.0:1789115366.052645:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115366.052665:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308215040:0@lo:400: 00000100:00100000:2.0:1789115366.052684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115366.052706:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308215168 00000100:00100000:2.0:1789115366.052711:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308215168 00000100:00100000:2.0:1789115366.052745:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789115366.052753:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8825a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308215168:12345-0@lo:400: 00000100:00100000:2.0:1789115366.052788:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8825a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308215168:12345-0@lo:400: Request processed in 36us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115366.052794:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789115366.052819:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50e8b40 x1876023308215168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115366.052828:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789115366.052840:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308215168:0@lo:400: 00000100:00080000:0.0:1789115366.052932:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789115366.054029:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308214784 00000100:00100000:1.0:1789115366.054041:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308214784 00000100:00100000:1.0:1789115366.054100:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308214656 00000100:00100000:1.0:1789115366.054104:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308214656 00000100:00100000:1.0:1789115366.054119:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308215040 00000100:00100000:1.0:1789115366.054121:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308215040 00000100:00100000:1.0:1789115366.054150:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789115366.054160:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308214784:12345-0@lo:400: 00000100:00100000:1.0:1789115366.054254:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308214784:12345-0@lo:400: Request processed in 95us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115366.054261:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789115366.054276:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789115366.054282:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308214656:12345-0@lo:400: 00000100:00100000:1.0:1789115366.054317:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308214656:12345-0@lo:400: Request processed in 36us (1809us total) trans 0 rc 0/0 00000100:00080000:0.0:1789115366.054428:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115366.054458:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308214528 00000100:00100000:0.0:1789115366.054462:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308214528 00000100:00100000:0.0:1789115366.054489:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789115366.054496:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308214528:12345-0@lo:400: 00000100:00100000:0.0:1789115366.054531:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308214528:12345-0@lo:400: Request processed in 36us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115366.054538:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789115366.054580:0:5850:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789115366.054588:0:5850:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789115366.054683:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789115366.054690:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8826940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308215040:12345-0@lo:400: 00000100:00100000:0.0:1789115366.054721:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8826940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308215040:12345-0@lo:400: Request processed in 31us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115366.054727:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789115366.054881:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308214528:0@lo:400: 00000100:00100000:0.0:1789115366.054898:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308215040:0@lo:400: 00000100:00100000:0.0:1789115366.054908:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308214656:0@lo:400: 00000100:00100000:2.0:1789115366.055176:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308214784:0@lo:400: 00000100:00100000:1.0:1789115366.056906:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789115366.115607:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115366.567496:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308215296:0@lo:13: 00000100:00100000:2.0:1789115366.567577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115366.567751:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308215296 00000100:00100000:1.0:1789115366.567773:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308215296 00000100:00100000:1.0:1789115366.567836:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789115366.567847:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8824780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308215296:12345-0@lo:13: 00002000:00000024:1.0:1789115366.567875:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115366.567929:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8824780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308215296:12345-0@lo:13: Request processed in 84us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115366.567936:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789115366.568504:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f0b40 x1876023308215296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115366.568527:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308215296:0@lo:13: 00010000:00010000:0.0:1789115367.145234:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115368.163573:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789115368.216824:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6dbf7574-92fb-4b89-af78-41319f924699 00000001:00100000:3.0:1789115368.223703:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6dbf7574-92fb-4b89-af78-41319f924699 00000100:00100000:2.0:1789115368.940253:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115368.940288:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115368.940321:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115368.940340:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115368.940376:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288270720 00000100:00100000:2.0:1789115368.940408:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288270720 00000100:00100000:2.0:1789115368.940468:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288270592 00000100:00100000:2.0:1789115368.940471:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288270592 00000100:00100000:2.0:1789115368.940503:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1789115368.940516:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8827c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288270720:12345-192.168.203.31@tcp:400: 00000100:00100000:2.0:1789115368.940611:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8827c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288270720:12345-192.168.203.31@tcp:400: Request processed in 84us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115368.940620:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1789115368.940640:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1789115368.940648:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8825680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288270592:12345-192.168.203.31@tcp:400: 00000100:00100000:2.0:1789115368.940674:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8825680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288270592:12345-192.168.203.31@tcp:400: Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115368.940680:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1789115368.940846:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288270464 00000100:00100000:0.0:1789115368.940852:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288270464 00000100:00100000:0.0:1789115368.940897:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1789115368.940906:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8826580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288270464:12345-192.168.203.31@tcp:400: 00000100:00100000:0.0:1789115368.940958:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8826580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288270464:12345-192.168.203.31@tcp:400: Request processed in 55us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115368.940965:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1789115368.940983:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288270336 00000100:00100000:0.0:1789115368.940986:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288270336 00000100:00100000:0.0:1789115368.941007:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:0.0:1789115368.941014:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288270336:12345-192.168.203.31@tcp:400: 00000100:00100000:0.0:1789115368.941037:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288270336:12345-192.168.203.31@tcp:400: Request processed in 24us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115368.941043:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00080000:0.0:1789115368.941070:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789115368.941075:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789115368.941077:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1789115369.001950:0:8300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789115369.187617:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115370.148054:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308215424:0@lo:13: 00000100:00100000:0.0:1789115370.148149:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115370.148290:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308215424 00000100:00100000:1.0:1789115370.148297:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308215424 00000100:00100000:1.0:1789115370.148356:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789115370.148364:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc332d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308215424:12345-0@lo:13: 00002000:00000024:1.0:1789115370.148434:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115370.148493:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc332d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308215424:12345-0@lo:13: Request processed in 128us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115370.148501:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789115370.148800:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789115370.148834:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f21c0 x1876023308215424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115370.148855:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308215424:0@lo:13: 00010000:00010000:3.0:1789115370.219886:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115371.172077:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8827840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308215808:0@lo:400: 00000100:00100000:3.0:1789115371.172089:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308215680:0@lo:400: 00000100:00100000:0.0:1789115371.172149:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc88261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308215552:0@lo:400: 00000100:00100000:3.0:1789115371.172313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115371.174025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115371.174087:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308216064:0@lo:400: 00000100:00100000:0.0:1789115371.174147:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308215552 00000100:00100000:0.0:1789115371.174162:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308215552 00000100:00100000:0.0:1789115371.174238:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789115371.174250:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308215552:12345-0@lo:400: 00000100:00100000:0.0:1789115371.174331:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308215552:12345-0@lo:400: Request processed in 82us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115371.174340:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789115371.180304:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc88252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308215936:0@lo:400: 00000100:00100000:2.0:1789115371.180358:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115371.181769:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308215936 00000100:00100000:0.0:1789115371.181781:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308215936 00000100:00100000:0.0:1789115371.181845:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789115371.181857:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8825e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308215936:12345-0@lo:400: 00000100:00100000:0.0:1789115371.182001:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8825e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308215936:12345-0@lo:400: Request processed in 146us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115371.182009:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789115371.182055:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115371.182073:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308216192:0@lo:400: 00000100:00100000:3.0:1789115371.182129:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789115371.182132:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc88252c0 x1876023308215936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115371.182150:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc88252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308215936:0@lo:400: 00000100:00100000:3.0:1789115371.182168:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308215680 00000100:00100000:3.0:1789115371.182172:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308215680 00000100:00100000:3.0:1789115371.182201:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308215808 00000100:00100000:0.0:1789115371.182202:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308216192 00000100:00100000:3.0:1789115371.182204:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308215808 00000100:00100000:0.0:1789115371.182204:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308216192 00000100:00100000:0.0:1789115371.182234:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789115371.182240:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308216192:12345-0@lo:400: 00000100:00100000:0.0:1789115371.182276:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308216192:12345-0@lo:400: Request processed in 36us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115371.182281:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789115371.182281:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789115371.182290:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308215680:12345-0@lo:400: 00000100:00100000:1.0:1789115371.182326:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308215680:12345-0@lo:400: Request processed in 38us (10015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115371.182332:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789115371.182504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115371.182543:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc88261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308215552:0@lo:400: 00000100:00100000:1.0:1789115371.182808:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308216064 00000100:00100000:1.0:1789115371.182813:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308216064 00000100:00080000:0.0:1789115371.183984:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789115371.183990:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789115371.184040:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789115371.184054:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308216064:12345-0@lo:400: 00000100:00100000:2.0:1789115371.184161:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308216064:12345-0@lo:400: Request processed in 112us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115371.184170:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789115371.184331:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308216064:0@lo:400: 00000100:00100000:3.0:1789115371.189823:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789115371.189841:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc333840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308215808:12345-0@lo:400: 00000100:00100000:1.0:1789115371.190164:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8827840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308215808:0@lo:400: 00000100:00100000:3.0:1789115371.190225:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc333840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308215808:12345-0@lo:400: Request processed in 390us (8168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115371.190233:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789115371.193485:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308215680:0@lo:400: 00010000:00080000:3.0:1789115371.193509:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc8826d00 x1876023308216192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115371.193521:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308216192:0@lo:400: 00010000:00010000:3.0:1789115371.236711:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115371.686637:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789115371.686665:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308216320:0@lo:13: 00000100:00100000:0.0:1789115371.686744:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115371.686820:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308216320 00000100:00100000:0.0:1789115371.686830:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308216320 00000100:00100000:0.0:1789115371.686886:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789115371.686896:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308216320:12345-0@lo:13: 00002000:00000024:0.0:1789115371.686952:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115371.687005:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308216320:12345-0@lo:13: Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115371.687013:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789115371.687062:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc333480 x1876023308216320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115371.687082:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308216320:0@lo:13: 00010000:00010000:0.0:1789115372.263497:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789115372.347348:0:8447:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff0e4c410 20000000:00000080:0.0:1789115372.347375:0:8447:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dfcf50e3c00 uarg=0000000000000000 20000000:01000000:0.0:1789115372.347473:0:8447:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789115372.347476:0:8447:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789115372.347479:0:8447:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789115372.347485:0:8447:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789115372.347492:0:8447:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789115372.347508:0:8447:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789115372.347511:0:8447:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789115372.347737:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789115372.347741:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789115372.355980:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789115372.357070:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789115372.357170:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789115372.357741:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1789115372.357765:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789115372.357768:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789115372.360221:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1789115372.364349:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1789115372.364879:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1789115372.364963:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1789115372.364981:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789115372.364985:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789115372.368865:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789115372.369971:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789115372.370054:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1789115372.370118:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1789115372.370136:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789115372.370140:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789115372.375044:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1789115372.377822:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1789115372.377885:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1789115372.377923:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1789115372.377947:0:8447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789115372.377971:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.377989:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2ff5 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.377998:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d3026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d301f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.380919:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d3050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3049 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.380952:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d305e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3057 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.380960:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d306c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3065 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.380967:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcda95c400/0xa47abda6516d3088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3081 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.380998:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d30b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d30ab expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.381021:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d30c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39ab expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.381031:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d30c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39b2 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.381041:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.381102:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d30c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39b2 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.381121:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d30c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39b2 expref: 9 pid: 5846 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115372.381139:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f12c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308216448:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115372.381282:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d30c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39ab expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.381290:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d30c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39ab expref: 9 pid: 5844 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115372.381298:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308216576:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115372.381330:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d30b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d30ab expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.381349:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d30b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d30ab expref: 18 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115372.381359:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308216704:0@lo:104: 00000100:00100000:2.0:1789115372.392317:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115372.392364:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115372.392534:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288270848 00000100:00100000:0.0:1789115372.392544:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288270848 00010000:00010000:0.0:1789115372.392601:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d30c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39b2 expref: 10 pid: 5846 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115372.392650:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288270976 00000100:00100000:0.0:1789115372.392653:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288270976 00010000:00010000:0.0:1789115372.392668:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d30c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39ab expref: 11 pid: 5844 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115372.392718:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1789115372.392728:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:2352:x1876023288270848:12345-192.168.203.31@tcp:103: 00010000:00010000:0.0:1789115372.392745:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115372.392751:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d30c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39b2 expref: 11 pid: 5846 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115372.392765:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d30c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39b2 expref: 11 pid: 5846 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115372.392788:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115372.392850:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:2352:x1876023288270848:12345-192.168.203.31@tcp:103: Request processed in 123us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115372.392859:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1789115372.392879:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1789115372.392887:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88243c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2352:x1876023288270976:12345-192.168.203.31@tcp:103: 00010000:00010000:0.0:1789115372.392895:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115372.392900:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d30c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39ab expref: 10 pid: 5844 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115372.392911:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d30c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39ab expref: 10 pid: 5844 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115372.392922:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115372.392942:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88243c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2352:x1876023288270976:12345-192.168.203.31@tcp:103: Request processed in 56us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115372.392949:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1789115372.396691:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789115372.396966:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcda95c400/0xa47abda6516d3088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d3081 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115372.396985:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcda95c400/0xa47abda6516d3088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d3081 expref: 18 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115372.397001:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc88270c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308216832:0@lo:104: 00000100:00100000:2.0:1789115372.397066:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789115372.397162:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d306c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d3065 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115372.397172:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d306c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d3065 expref: 18 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115372.397196:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308216960:0@lo:104: 00010000:00010000:2.0:1789115372.397226:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d305e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d3057 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115372.397235:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d305e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d3057 expref: 18 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115372.397243:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308217088:0@lo:104: 00010000:00010000:2.0:1789115372.397342:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d3050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d3049 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115372.397352:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d3050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d3049 expref: 18 pid: 5843 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115372.397361:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8827480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308217216:0@lo:104: 00010000:00010000:2.0:1789115372.397566:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d3026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d301f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115372.397585:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d3026 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d301f expref: 18 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115372.397594:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8827840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308217344:0@lo:104: 00010000:00010000:2.0:1789115372.397624:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2ff5 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115372.397631:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2ffc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2ff5 expref: 18 pid: 5843 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115372.397638:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308217472:0@lo:104: 00000100:00100000:2.0:1789115372.397655:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876540 going to sleep for 11 seconds 00010000:00010000:2.0:1789115372.397687:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d30c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39b2 expref: 9 pid: 5846 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115372.397706:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f12c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308216448:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789115372.397719:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d30c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39ab expref: 8 pid: 5844 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115372.397744:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308216576:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115372.397955:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789115372.397978:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115372.397994:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115372.398002:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115372.398009:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115372.398016:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115372.398024:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308216704 00000100:00100000:3.0:1789115372.398030:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308216704 00000100:00100000:3.0:1789115372.398083:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308216832 00000100:00100000:3.0:1789115372.398086:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308216832 00000100:00100000:3.0:1789115372.398108:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308216960 00000100:00100000:3.0:1789115372.398111:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308216960 00000100:00100000:3.0:1789115372.398120:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308217088 00000100:00100000:3.0:1789115372.398122:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308217088 00000100:00100000:3.0:1789115372.398131:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308217216 00000100:00100000:3.0:1789115372.398133:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308217216 00000100:00100000:3.0:1789115372.398140:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308217344 00000100:00100000:3.0:1789115372.398143:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308217344 00000100:00100000:3.0:1789115372.398150:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308217472 00000100:00100000:3.0:1789115372.398151:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308217472 00000100:00100000:3.0:1789115372.398163:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789115372.398171:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+9:8447:x1876023308216704:12345-0@lo:104: 00010000:00010000:3.0:1789115372.398245:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d30b2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.398313:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789115372.398319:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+9:8447:x1876023308216704:12345-0@lo:104: Request processed in 149us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115372.398326:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789115372.398346:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789115372.398352:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf58c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+8:8447:x1876023308216832:12345-0@lo:104: 00010000:00010000:3.0:1789115372.398361:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3088 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.398490:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789115372.398496:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf58c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+8:8447:x1876023308216832:12345-0@lo:104: Request processed in 145us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115372.398503:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789115372.398547:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789115372.398554:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+7:8447:x1876023308216960:12345-0@lo:104: 00010000:00010000:3.0:1789115372.398562:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d306c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115372.398683:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308216704:0@lo:104: 00000100:00100000:2.0:1789115372.398693:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc88270c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308216832:0@lo:104: 00010000:00010000:1.0:1789115372.398758:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789115372.398766:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d30b2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.398774:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95d600 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:1.0:1789115372.398778:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d30b2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.398786:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d30b2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115372.398794:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d30b2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115372.398800:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789115372.398841:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d30b2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.398848:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115372.398869:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d30b2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.398875:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d600/0xa47abda6516d30ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d30b2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.398900:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115372.398903:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3088 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.398908:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521a00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:1.0:1789115372.398911:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d3088 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.398918:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d3088 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115372.398924:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d3088 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115372.398929:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789115372.398942:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3088 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.398947:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115372.398962:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3088 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.398968:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d3081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3088 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.398977:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115372.398979:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115372.398980:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115372.398995:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308217600:0@lo:103: 00000100:00100000:1.0:1789115372.399040:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115372.399102:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308217728:0@lo:103: 00000100:00100000:1.0:1789115372.399126:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115372.399160:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308217600 00000100:00100000:1.0:1789115372.399165:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308217600 00010000:00010000:3.0:1789115372.399290:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789115372.399296:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+7:8447:x1876023308216960:12345-0@lo:104: Request processed in 743us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115372.399302:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789115372.399319:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789115372.399327:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+6:8447:x1876023308217088:12345-0@lo:104: 00010000:00010000:3.0:1789115372.399336:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d305e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.399368:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789115372.399373:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+6:8447:x1876023308217088:12345-0@lo:104: Request processed in 48us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115372.399526:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308216960:0@lo:104: 00000100:00100000:2.0:1789115372.399536:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308217088:0@lo:104: 00010000:00010000:1.0:1789115372.399723:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d30b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d30ab expref: 19 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115372.399749:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308217728 00000100:00100000:1.0:1789115372.399753:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308217728 00010000:00010000:1.0:1789115372.399767:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcda95c400/0xa47abda6516d3088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d3081 expref: 20 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115372.399786:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789115372.399793:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa71a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+20:3308:x1876023308217600:12345-0@lo:103: 00010000:00010000:1.0:1789115372.399804:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115372.399809:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d30b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d30ab expref: 20 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.399820:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d30b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d30ab expref: 20 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.399836:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcda95d400/0xa47abda6516d30b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d30ab expref: 20 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.399850:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115372.399883:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa71a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3308:x1876023308217600:12345-0@lo:103: Request processed in 91us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115372.399890:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789115372.399906:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789115372.399921:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+18:3305:x1876023308217728:12345-0@lo:103: 00010000:00010000:1.0:1789115372.399929:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115372.399933:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcda95c400/0xa47abda6516d3088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d3081 expref: 18 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.399941:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcda95c400/0xa47abda6516d3088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d3081 expref: 18 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.399951:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcda95c400/0xa47abda6516d3088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d3081 expref: 18 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.399960:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115372.399987:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:3305:x1876023308217728:12345-0@lo:103: Request processed in 67us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115372.399992:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1789115372.400010:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789115372.400014:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d306c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.400021:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1520400 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:1.0:1789115372.400025:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d306c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.400033:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d306c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115372.400040:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d306c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115372.400045:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789115372.400106:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d306c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.400113:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115372.400124:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d306c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.400131:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3065 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d306c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.400141:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115372.400144:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d305e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.400150:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521400 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:1.0:1789115372.400153:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d305e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.400161:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d305e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115372.400168:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d305e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115372.400173:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789115372.400261:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789115372.400285:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789115372.400293:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+5:8447:x1876023308217216:12345-0@lo:104: 00010000:00010000:3.0:1789115372.400303:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3050 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.400339:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789115372.400344:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+5:8447:x1876023308217216:12345-0@lo:104: Request processed in 53us (2341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115372.400350:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789115372.400371:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789115372.400377:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+4:8447:x1876023308217344:12345-0@lo:104: 00000100:00100000:2.0:1789115372.400540:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8827480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308217216:0@lo:104: 00010000:00010000:3.0:1789115372.400654:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3026 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.400702:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789115372.400707:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+4:8447:x1876023308217344:12345-0@lo:104: Request processed in 331us (2697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115372.400713:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789115372.400726:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789115372.400733:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+3:8447:x1876023308217472:12345-0@lo:104: 00010000:00010000:3.0:1789115372.400742:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2ffc expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.400774:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789115372.400779:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+3:8447:x1876023308217472:12345-0@lo:104: Request processed in 47us (2762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115372.400785:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789115372.400804:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789115372.400809:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3050 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.400816:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c4400 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115372.400819:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d3050 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.400827:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d3050 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115372.400845:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d3050 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115372.400851:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789115372.400870:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3050 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.400877:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115372.400892:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3050 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.400900:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4400/0xa47abda6516d3049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3050 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.400913:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789115372.400915:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3026 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.400919:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95d800 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115372.400922:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d3026 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.400928:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d3026 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115372.400935:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d3026 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115372.400941:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789115372.400961:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3026 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.400967:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115372.400973:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3026 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.400980:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d800/0xa47abda6516d301f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3026 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.400992:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115372.400995:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2ffc expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.401001:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c5400 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115372.401004:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2ffc expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.401011:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2ffc expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115372.401017:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2ffc expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115372.401022:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789115372.401034:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2ffc expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.401041:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115372.401047:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2ffc expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.401063:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d2ff5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2ffc expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.401074:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115372.401076:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115372.401077:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115372.401085:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115372.401348:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8827840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308217344:0@lo:104: 00000100:00100000:2.0:1789115372.401360:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876023308217472:0@lo:104: 00010000:00010000:2.0:1789115372.401540:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.402200:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d305e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.402210:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115372.402218:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d305e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.402239:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3057 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d305e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.402257:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115372.402260:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115372.402262:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115372.402293:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308218112:0@lo:103: 00000100:00100000:1.0:1789115372.402352:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115372.402659:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308217600:0@lo:103: 00000100:00100000:1.0:1789115372.402683:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789115372.402689:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308217984:0@lo:103: 00000100:00100000:1.0:1789115372.402713:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115372.402748:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308218240:0@lo:103: 00000100:00100000:1.0:1789115372.402774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115372.402790:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308217728:0@lo:103: 00000100:00100000:1.0:1789115372.402803:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789115372.402809:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff972940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308217856:0@lo:103: 00000100:00100000:1.0:1789115372.402832:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115372.402843:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308218368:0@lo:103: 00000100:00100000:1.0:1789115372.402860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115372.402896:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308218112 00000100:00100000:1.0:1789115372.402901:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308218112 00010000:00010000:1.0:1789115372.402933:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d3026 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d301f expref: 17 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115372.402968:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308217984 00000100:00100000:1.0:1789115372.402972:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308217984 00010000:00010000:1.0:1789115372.402985:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d3050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d3049 expref: 18 pid: 5843 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115372.402998:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308218240 00000100:00100000:1.0:1789115372.403000:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308218240 00010000:00010000:1.0:1789115372.403012:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2ffc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2ff5 expref: 19 pid: 5843 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115372.403023:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308217856 00000100:00100000:1.0:1789115372.403025:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308217856 00010000:00010000:1.0:1789115372.403037:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d306c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d3065 expref: 20 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115372.403048:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308218368 00000100:00100000:1.0:1789115372.403050:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308218368 00010000:00010000:1.0:1789115372.403062:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d305e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d3057 expref: 21 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115372.403075:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789115372.403083:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff972580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+21:3308:x1876023308218112:12345-0@lo:103: 00010000:00010000:1.0:1789115372.403110:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115372.403115:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d3026 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d301f expref: 21 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.403125:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d3026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d301f expref: 21 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.403140:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d3026 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d301f expref: 21 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115372.403159:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115372.403863:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789115372.403878:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff973c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+20:3308:x1876023308217984:12345-0@lo:103: 00010000:00010000:3.0:1789115372.403890:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115372.403895:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d3050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d3049 expref: 20 pid: 5843 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.403904:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d3050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d3049 expref: 20 pid: 5843 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.403916:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d3050 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d3049 expref: 20 pid: 5843 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.403928:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115372.403976:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff973c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3308:x1876023308217984:12345-0@lo:103: Request processed in 104us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115372.403982:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789115372.404004:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789115372.404012:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+18:3305:x1876023308218240:12345-0@lo:103: 00010000:00010000:3.0:1789115372.404021:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115372.404025:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2ffc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2ff5 expref: 18 pid: 5843 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404042:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2ff5 expref: 18 pid: 5843 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404054:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc1520e00/0xa47abda6516d2ffc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2ff5 expref: 18 pid: 5843 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404065:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115372.404107:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:3305:x1876023308218240:12345-0@lo:103: Request processed in 96us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115372.404114:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789115372.404127:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789115372.404134:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff971680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:3305:x1876023308217856:12345-0@lo:103: 00010000:00010000:3.0:1789115372.404141:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115372.404146:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d306c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d3065 expref: 16 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404156:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d306c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d3065 expref: 16 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404166:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d306c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d3065 expref: 16 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404175:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115372.404211:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff971680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+15:3305:x1876023308217856:12345-0@lo:103: Request processed in 78us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115372.404218:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789115372.404233:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789115372.404240:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff970000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+14:3305:x1876023308218368:12345-0@lo:103: 00010000:00010000:3.0:1789115372.404254:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115372.404260:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d305e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d3057 expref: 14 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404269:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d305e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d3057 expref: 14 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404278:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d305e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d3057 expref: 14 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404289:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404298:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404313:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404319:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404325:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404331:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404336:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95d000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115372.404340:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404358:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404371:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115372.404405:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115372.404430:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff970000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:3305:x1876023308218368:12345-0@lo:103: Request processed in 191us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115372.404436:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789115372.404603:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:0.0:1789115372.404685:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308217984:0@lo:103: 00000100:00100000:0.0:1789115372.404723:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff972940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308217856:0@lo:103: 00000100:00100000:0.0:1789115372.404732:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308218368:0@lo:103: 00000100:00100000:0.0:1789115372.404739:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308218240:0@lo:103: 00010000:00010000:2.0:1789115372.405448:0:8447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115372.405461:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115372.405467:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcda95d000/0xa47abda6516d30ff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115372.407263:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff972580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+12:3308:x1876023308218112:12345-0@lo:103: Request processed in 2100us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115372.407279:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789115372.407738:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308218112:0@lo:103: 00010000:00010000:2.0:1789115373.284481:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115373.737329:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115373.737690:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288271104 00000100:00100000:0.0:1789115373.737700:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288271104 00000100:00100000:0.0:1789115373.737760:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:0.0:1789115373.737769:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+8:5593:x1876023288271104:12345-192.168.203.31@tcp:101: 00010000:00010000:0.0:1789115373.737786:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115373.737806:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28fe00/0xa47abda6516d3106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3a14 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115373.737833:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28fe00/0xa47abda6516d3106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a14 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115373.737844:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28fe00/0xa47abda6516d3106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a14 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115373.737853:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28fe00, rc 0) 00000100:00100000:0.0:1789115373.738001:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:5593:x1876023288271104:12345-192.168.203.31@tcp:101: Request processed in 233us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115373.738008:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:2.0:1789115373.750263:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115373.750891:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288271232 00000100:00100000:0.0:1789115373.750920:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288271232 00000100:00100000:0.0:1789115373.750975:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:0.0:1789115373.750986:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:5593:x1876023288271232:12345-192.168.203.31@tcp:501: 00000100:00100000:0.0:1789115373.752054:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:5593:x1876023288271232:12345-192.168.203.31@tcp:501: Request processed in 1061us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115373.752068:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:3.0:1789115373.764448:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115373.764586:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288271360 00000100:00100000:0.0:1789115373.764597:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288271360 00000100:00100000:0.0:1789115373.764676:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:0.0:1789115373.764688:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:5593:x1876023288271360:12345-192.168.203.31@tcp:503: 00000100:00100000:0.0:1789115373.765001:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:5593:x1876023288271360:12345-192.168.203.31@tcp:503: Request processed in 314us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115373.765010:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:3.0:1789115373.775642:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115373.777529:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288271488 00000100:00100000:0.0:1789115373.777546:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288271488 00000100:00100000:0.0:1789115373.777642:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:0.0:1789115373.777653:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:6065:x1876023288271488:12345-192.168.203.31@tcp:502: 00000100:00100000:0.0:1789115373.778019:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:6065:x1876023288271488:12345-192.168.203.31@tcp:502: Request processed in 367us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115373.778028:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:1.0:1789115373.803796:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115373.803980:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288271616 00000100:00100000:2.0:1789115373.803990:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288271616 00000100:00100000:2.0:1789115373.804037:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:2.0:1789115373.804047:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:6065:x1876023288271616:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789115373.804506:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:6065:x1876023288271616:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 458us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115373.804516:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:3.0:1789115373.819654:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115373.821454:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288271744 00000100:00100000:1.0:1789115373.821471:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288271744 00000100:00100000:1.0:1789115373.821557:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:1.0:1789115373.821568:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:5593:x1876023288271744:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115373.821587:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115373.821619:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcda95d600/0xa47abda6516d310d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3a1b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115373.821652:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcda95d600/0xa47abda6516d310d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a1b expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115373.821663:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcda95d600/0xa47abda6516d310d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a1b expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115373.821673:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcda95d600, rc 0) 00000100:00100000:1.0:1789115373.821764:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5593:x1876023288271744:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 197us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115373.821772:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:3.0:1789115373.825506:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115373.825778:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288271872 00000100:00100000:0.0:1789115373.825788:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288271872 00000100:00100000:0.0:1789115373.825850:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:0.0:1789115373.825860:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5593:x1876023288271872:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115373.837444:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5593:x1876023288271872:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 11570us (11938us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789115373.837462:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:3.0:1789115374.055814:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115374.055868:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115374.055905:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115374.055948:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115374.055954:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288272128 00000100:00100000:1.0:1789115374.055965:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288272128 00000100:00100000:2.0:1789115374.056012:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288272000 00000100:00100000:2.0:1789115374.056027:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288272000 00000100:00100000:1.0:1789115374.056067:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:1.0:1789115374.056089:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288272128:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115374.056109:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:2.0:1789115374.056123:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288272000:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115374.056256:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288272384 00000100:00100000:0.0:1789115374.056263:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288272384 00000100:00100000:0.0:1789115374.056318:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288272256 00000100:00100000:0.0:1789115374.056322:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288272256 00000100:00100000:0.0:1789115374.056355:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1789115374.056364:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288272384:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115374.058277:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288272000:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 2144us (2357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115374.058293:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:1.0:1789115374.058818:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288272128:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 2729us (3007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115374.058833:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:1.0:1789115374.058907:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1789115374.058923:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288272256:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:2.0:1789115374.058994:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789115374.059004:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288272256:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 83us (3052us total) trans 0 rc 0/0 00000100:00080000:2.0:1789115374.059006:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789115374.059014:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115374.059021:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:0.0:1789115374.060592:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288272384:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 4221us (4714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115374.060817:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 10000000:01000000:1.0:1789115374.115564:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789115374.115575:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dfcff92b000 from 39 10000000:01000000:1.0:1789115374.115583:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789115374.115642:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.115656:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.115670:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115374.115699:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff973c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308218496:0@lo:101: 00000100:00100000:1.0:1789115374.115789:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115374.115880:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789115374.115970:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308218496 00000100:00100000:0.0:1789115374.115978:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308218496 00000100:00100000:0.0:1789115374.116029:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789115374.116040:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+12:5848:x1876023308218496:12345-0@lo:101: 00010000:00010000:0.0:1789115374.116056:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115374.116073:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28e800/0xa47abda6516d311b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d3114 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115374.116110:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28e800/0xa47abda6516d311b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d3114 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115374.116121:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28e800/0xa47abda6516d311b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3114 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115374.116130:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e800, rc 0) 00000100:00100000:0.0:1789115374.116178:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:5848:x1876023308218496:12345-0@lo:101: Request processed in 140us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115374.116184:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789115374.116509:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff973c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308218496:0@lo:101: 00010000:00010000:1.0:1789115374.116542:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d311b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.116552:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d311b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115374.116761:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff973c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308218624:0@lo:501: 00000100:00100000:1.0:1789115374.116798:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115374.116840:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789115374.117221:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308218624 00000100:00100000:2.0:1789115374.117228:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308218624 00000100:00100000:2.0:1789115374.117274:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789115374.117284:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+13:5848:x1876023308218624:12345-0@lo:501: 00000100:00100000:2.0:1789115374.117687:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+13:5848:x1876023308218624:12345-0@lo:501: Request processed in 402us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115374.117695:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789115374.118155:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff973c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308218624:0@lo:501: 00000100:00100000:1.0:1789115374.118204:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff973c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308218752:0@lo:503: 00000100:00100000:1.0:1789115374.118259:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115374.118298:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789115374.118354:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308218752 00000100:00100000:0.0:1789115374.118359:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308218752 00000100:00100000:0.0:1789115374.118423:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789115374.118431:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:5848:x1876023308218752:12345-0@lo:503: 00000100:00100000:0.0:1789115374.118636:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:5848:x1876023308218752:12345-0@lo:503: Request processed in 206us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115374.118643:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789115374.118790:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff973c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308218752:0@lo:503: 00000100:00100000:1.0:1789115374.119589:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff973c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8465:1876023308218880:0@lo:502: 00000100:00100000:1.0:1789115374.119651:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115374.119803:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876900 going to sleep for 11 seconds 00000100:00100000:0.0:1789115374.120511:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308218880 00000100:00100000:0.0:1789115374.120523:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308218880 00000100:00100000:0.0:1789115374.120635:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789115374.120647:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:8465:x1876023308218880:12345-0@lo:502: 00000100:00100000:0.0:1789115374.121162:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+13:8465:x1876023308218880:12345-0@lo:502: Request processed in 516us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115374.121171:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789115374.121297:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff973c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8465:1876023308218880:0@lo:502: 00000100:00100000:3.0:1789115374.121365:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8465:1876023308219008:0@lo:502: 00000100:00100000:3.0:1789115374.121449:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115374.123349:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc2f079c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115374.123484:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308219008 00000100:00100000:0.0:1789115374.123493:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308219008 00000100:00100000:1.0:1789115374.123559:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789115374.123573:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:8465:x1876023308219008:12345-0@lo:502: 00000100:00100000:1.0:1789115374.123985:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:8465:x1876023308219008:12345-0@lo:502: Request processed in 414us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115374.123993:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789115374.124113:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8465:1876023308219008:0@lo:502: 00000040:00080000:3.0:1789115374.124153:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789115374.124276:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789115374.124311:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789115374.124322:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d311b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.124343:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d311b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115374.124354:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789115374.124357:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789115374.124360:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789115374.124414:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.124423:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.124433:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115374.124452:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff972580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308219136:0@lo:101: 00000100:00100000:1.0:1789115374.124490:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115374.124530:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876480 going to sleep for 11 seconds 00000100:00100000:0.0:1789115374.124779:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308219136 00000100:00100000:0.0:1789115374.124785:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308219136 00000100:00100000:0.0:1789115374.124826:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789115374.124835:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+13:5848:x1876023308219136:12345-0@lo:101: 00010000:00010000:0.0:1789115374.124846:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115374.124858:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d3129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d3122 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115374.124881:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d3129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d3122 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115374.124891:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d3129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3122 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115374.124900:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28fc00, rc 0) 00000100:00100000:0.0:1789115374.124949:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308219136:12345-0@lo:101: Request processed in 116us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115374.124962:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789115374.125425:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff972580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308219136:0@lo:101: 00010000:00010000:3.0:1789115374.125451:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3129 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.125460:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3129 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115374.125525:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308219264:0@lo:501: 00000100:00100000:3.0:1789115374.125562:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115374.125591:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc2f079c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789115374.125646:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308219264 00000100:00100000:1.0:1789115374.125650:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308219264 00000100:00100000:1.0:1789115374.125844:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789115374.125852:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308219264:12345-0@lo:501: 00000100:00100000:1.0:1789115374.129449:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308219264:12345-0@lo:501: Request processed in 3583us (3871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115374.129467:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789115374.129706:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308219264:0@lo:501: 00000100:00100000:3.0:1789115374.129768:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308219392:0@lo:503: 00000100:00100000:3.0:1789115374.129824:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115374.129861:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc2f079c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115374.129970:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308219392 00000100:00100000:0.0:1789115374.129978:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308219392 00000100:00100000:0.0:1789115374.130039:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789115374.130050:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308219392:12345-0@lo:503: 00000100:00100000:0.0:1789115374.130447:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308219392:12345-0@lo:503: Request processed in 397us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115374.130454:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789115374.130554:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308219392:0@lo:503: 00000100:00100000:1.0:1789115374.131137:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8466:1876023308219520:0@lo:502: 00000100:00100000:1.0:1789115374.131652:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115374.131774:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308219520 00000100:00100000:0.0:1789115374.131782:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308219520 00000100:00100000:0.0:1789115374.131828:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789115374.131837:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+14:8466:x1876023308219520:12345-0@lo:502: 00000100:00100000:0.0:1789115374.132094:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+14:8466:x1876023308219520:12345-0@lo:502: Request processed in 257us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115374.132102:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789115374.132501:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876780 going to sleep for 11 seconds 00000100:00100000:1.0:1789115374.132529:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8466:1876023308219520:0@lo:502: 00000020:01000000:1.0:1789115374.132563:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115374.132575:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115374.132578:0:8466:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789115374.132584:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789115374.132615:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8466:1876023308219648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115374.132663:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115374.132762:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308219648 00000100:00100000:3.0:1789115374.132767:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308219648 00000100:00100000:3.0:1789115374.132794:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789115374.132801:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+14:8466:x1876023308219648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789115374.132949:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+14:8466:x1876023308219648:12345-0@lo:502:llog_process_th.0 Request processed in 147us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115374.132955:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789115374.133000:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876780 going to sleep for 11 seconds 00000100:00100000:1.0:1789115374.133013:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8466:1876023308219648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789115374.133164:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115374.133170:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115374.133172:0:8466:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789115374.133176:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789115374.134253:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1789115374.134286:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789115374.134308:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3129 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.134322:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3129 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115374.134353:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789115374.134356:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dfcd8ba8800 from 39 10000000:01000000:3.0:1789115374.134358:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789115374.134432:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.134441:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.134451:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115374.134475:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308219776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789115374.134541:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115374.134580:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc2f07480 going to sleep for 11 seconds 00000100:00100000:0.0:1789115374.134795:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308219776 00000100:00100000:0.0:1789115374.134803:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308219776 00000100:00100000:0.0:1789115374.134853:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789115374.134862:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+14:5848:x1876023308219776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789115374.134876:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115374.134891:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d3137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d3130 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115374.134916:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d3137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d3130 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115374.134926:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d3137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3130 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115374.134944:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f400, rc 0) 00000100:00100000:0.0:1789115374.134992:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308219776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115374.134999:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789115374.135184:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308219776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115374.135210:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.135220:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115374.135277:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308219904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115374.135320:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115374.135341:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876780 going to sleep for 11 seconds 00000100:00100000:0.0:1789115374.135553:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308219904 00000100:00100000:0.0:1789115374.135558:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308219904 00000100:00100000:0.0:1789115374.135587:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789115374.135594:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308219904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789115374.135907:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308219904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115374.135914:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789115374.136038:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308219904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115374.136091:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308220032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115374.136138:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115374.136168:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd0dca840 going to sleep for 11 seconds 00000100:00100000:1.0:1789115374.136365:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308220032 00000100:00100000:1.0:1789115374.136370:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308220032 00000100:00100000:1.0:1789115374.136429:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789115374.136435:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308220032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115374.136603:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308220032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115374.136610:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789115374.136890:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308220032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115374.137611:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8467:1876023308220160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115374.137674:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115374.137719:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd0dca180 going to sleep for 11 seconds 00000100:00100000:1.0:1789115374.137769:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308220160 00000100:00100000:1.0:1789115374.137774:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308220160 00000100:00100000:1.0:1789115374.137811:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789115374.137818:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+15:8467:x1876023308220160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115374.138139:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+15:8467:x1876023308220160:12345-0@lo:502:llog_process_th.0 Request processed in 319us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115374.138146:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789115374.138285:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8467:1876023308220160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115374.138492:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8467:1876023308220288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115374.138531:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115374.138550:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd05e0240 going to sleep for 11 seconds 00000100:00100000:3.0:1789115374.138624:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308220288 00000100:00100000:3.0:1789115374.138629:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308220288 00000100:00100000:3.0:1789115374.138662:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789115374.138670:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+15:8467:x1876023308220288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789115374.138832:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+15:8467:x1876023308220288:12345-0@lo:502:llog_process_th.0 Request processed in 163us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115374.138839:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789115374.138941:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8467:1876023308220288:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789115374.138961:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789115374.139753:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789115374.139778:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789115374.139789:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.139802:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115374.139812:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789115374.139814:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789115374.139817:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789115374.139851:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.139859:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.139883:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115374.139903:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff973480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308220416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789115374.139950:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115374.140026:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789115374.140173:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308220416 00000100:00100000:3.0:1789115374.140347:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308220416 00000100:00100000:3.0:1789115374.140521:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789115374.140531:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+15:5848:x1876023308220416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115374.140543:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115374.140565:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfd021c5a00/0xa47abda6516d3145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d313e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.140590:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfd021c5a00/0xa47abda6516d3145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d313e expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.140600:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfd021c5a00/0xa47abda6516d3145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d313e expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.140609:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c5a00, rc 0) 00000100:00100000:3.0:1789115374.140666:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308220416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115374.140673:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789115374.140742:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff973480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308220416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789115374.140758:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3145 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115374.140768:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3145 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115374.140827:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308220544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115374.140857:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115374.140954:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd05e0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789115374.141022:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308220544 00000100:00100000:1.0:1789115374.141027:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308220544 00000100:00100000:1.0:1789115374.141065:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789115374.141072:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308220544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115374.141418:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308220544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 345us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115374.141426:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789115374.141564:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308220544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115374.141597:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308220672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115374.141639:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115374.141666:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd05e0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789115374.141921:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308220672 00000100:00100000:1.0:1789115374.141926:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308220672 00000100:00100000:1.0:1789115374.141946:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789115374.141952:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308220672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115374.142162:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308220672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115374.142169:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789115374.142374:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308220672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115374.143069:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8468:1876023308220800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115374.143133:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115374.143171:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd05e09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789115374.143503:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308220800 00000100:00100000:1.0:1789115374.143509:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308220800 00000100:00100000:1.0:1789115374.143538:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789115374.143546:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:8468:x1876023308220800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115374.143782:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:8468:x1876023308220800:12345-0@lo:502:llog_process_th.0 Request processed in 236us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115374.143797:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789115374.143871:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8468:1876023308220800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789115374.143902:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789115374.143913:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115374.143915:0:8468:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789115374.143921:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789115374.143945:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8468:1876023308220928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115374.143981:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115374.144010:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd0dca180 going to sleep for 11 seconds 00000100:00100000:1.0:1789115374.144051:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308220928 00000100:00100000:1.0:1789115374.144055:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308220928 00000100:00100000:1.0:1789115374.144091:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789115374.144097:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:8468:x1876023308220928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115374.144559:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:8468:x1876023308220928:12345-0@lo:502:llog_process_th.0 Request processed in 461us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115374.144565:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789115374.144625:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8468:1876023308220928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789115374.144644:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115374.144649:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115374.144650:0:8468:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789115374.144654:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789115374.145011:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789115374.145043:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789115374.145060:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3145 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.145071:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3145 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115374.145090:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789115374.145092:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dfcc65aa800 from 39 10000000:01000000:1.0:1789115374.145095:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789115374.145125:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.145134:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.145142:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115374.145160:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff973840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308221056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789115374.145574:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115374.145625:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876540 going to sleep for 11 seconds 00000100:00100000:2.0:1789115374.145678:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308221056 00000100:00100000:2.0:1789115374.145684:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308221056 00000100:00100000:2.0:1789115374.145714:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789115374.145721:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308221056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789115374.145732:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115374.145746:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d3153 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d314c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115374.145771:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d3153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d314c expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115374.145793:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d3153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d314c expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115374.145802:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1521e00, rc 0) 00000100:00100000:2.0:1789115374.145844:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308221056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115374.145850:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789115374.145958:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff973840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308221056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115374.145972:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.145981:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115374.146040:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff973840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308221184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115374.146075:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115374.146101:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876540 going to sleep for 11 seconds 00000100:00100000:2.0:1789115374.146204:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308221184 00000100:00100000:2.0:1789115374.146209:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308221184 00000100:00100000:2.0:1789115374.146227:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789115374.146233:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308221184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115374.146766:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308221184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 529us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115374.146775:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789115374.146849:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff973840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308221184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115374.146886:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff973840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308221312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115374.146931:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115374.146965:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876540 going to sleep for 11 seconds 00000100:00100000:2.0:1789115374.147366:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308221312 00000100:00100000:2.0:1789115374.147372:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308221312 00000100:00100000:2.0:1789115374.147429:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789115374.147436:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308221312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115374.147628:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308221312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115374.147634:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789115374.147720:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff973840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308221312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115374.148736:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff973840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8469:1876023308221440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115374.148805:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115374.148847:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876600 going to sleep for 11 seconds 00000100:00100000:2.0:1789115374.148891:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308221440 00000100:00100000:2.0:1789115374.148896:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308221440 00000100:00100000:2.0:1789115374.148922:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789115374.148929:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:8469:x1876023308221440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115374.149581:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:8469:x1876023308221440:12345-0@lo:502:llog_process_th.0 Request processed in 649us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115374.149596:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789115374.149683:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff973840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8469:1876023308221440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115374.149737:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff973840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8469:1876023308221568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115374.149777:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115374.149812:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8876600 going to sleep for 11 seconds 00000100:00100000:3.0:1789115374.149894:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308221568 00000100:00100000:3.0:1789115374.149900:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308221568 00000100:00100000:3.0:1789115374.149930:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789115374.149937:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:8469:x1876023308221568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789115374.150149:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:8469:x1876023308221568:12345-0@lo:502:llog_process_th.0 Request processed in 213us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115374.150156:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789115374.150419:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff973840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8469:1876023308221568:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789115374.150439:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789115374.150674:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789115374.150692:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789115374.150702:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.150714:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115374.150724:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789115374.150734:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789115374.150738:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789115374.150764:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.150773:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.150782:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115374.150796:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308221696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789115374.150825:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115374.150860:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc2f07240 going to sleep for 11 seconds 00000100:00100000:1.0:1789115374.150901:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308221696 00000100:00100000:1.0:1789115374.150906:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308221696 00000100:00100000:1.0:1789115374.150927:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789115374.150933:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308221696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115374.150942:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115374.150954:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcda95d800/0xa47abda6516d3161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d315a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.150975:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcda95d800/0xa47abda6516d3161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d315a expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.150984:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcda95d800/0xa47abda6516d3161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d315a expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115374.150993:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcda95d800, rc 0) 00000100:00100000:1.0:1789115374.151025:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308221696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115374.151038:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789115374.151299:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308221696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115374.151312:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.151321:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115374.151367:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308221824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115374.151420:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115374.151434:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc2f07240 going to sleep for 11 seconds 00000100:00100000:2.0:1789115374.151494:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308221824 00000100:00100000:2.0:1789115374.151498:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308221824 00000100:00100000:2.0:1789115374.151518:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789115374.151524:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308221824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115374.151785:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308221824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115374.151792:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789115374.151854:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308221824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115374.151880:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308221952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115374.151920:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115374.151940:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc2f07240 going to sleep for 11 seconds 00000100:00100000:1.0:1789115374.152004:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308221952 00000100:00100000:1.0:1789115374.152008:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308221952 00000100:00100000:1.0:1789115374.152026:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789115374.152043:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308221952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115374.152489:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308221952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 455us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115374.152496:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789115374.152597:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308221952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115374.153167:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8470:1876023308222080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115374.153352:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115374.153535:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd06b5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789115374.153615:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308222080 00000100:00100000:1.0:1789115374.153628:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308222080 00000100:00100000:1.0:1789115374.153694:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789115374.153702:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:8470:x1876023308222080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115374.153982:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:8470:x1876023308222080:12345-0@lo:502:llog_process_th.0 Request processed in 280us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115374.153990:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789115374.154086:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8470:1876023308222080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789115374.154119:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789115374.154193:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115374.154197:0:8470:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789115374.154206:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789115374.154235:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8470:1876023308222208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789115374.154277:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115374.154816:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115374.154901:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308222208 00000100:00100000:2.0:1789115374.154906:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308222208 00000100:00100000:2.0:1789115374.154935:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789115374.154942:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+18:8470:x1876023308222208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115374.155480:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+18:8470:x1876023308222208:12345-0@lo:502:llog_process_th.0 Request processed in 536us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115374.155486:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789115374.155564:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8470:1876023308222208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789115374.155590:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789115374.155597:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115374.155600:0:8470:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789115374.155605:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789115374.155837:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1789115374.155861:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789115374.155870:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115374.155882:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115374.155904:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789115374.155907:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dfcd92d3490 from 1 10000000:01000000:2.0:1789115374.155910:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789115374.155936:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115374.155943:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115374.155952:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115374.155969:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8827840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308222336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789115374.156005:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115374.156043:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd06b5240 going to sleep for 11 seconds 00000100:00100000:1.0:1789115374.156143:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308222336 00000100:00100000:1.0:1789115374.156149:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308222336 00000100:00100000:3.0:1789115374.156319:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789115374.156329:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308222336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115374.156341:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115374.156354:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d316f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d3168 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.156377:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d316f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d3168 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.156420:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d316f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3168 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.156429:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c4800, rc 0) 00000100:00100000:3.0:1789115374.156464:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308222336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115374.156478:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789115374.156648:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8827840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308222336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789115374.156661:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d316f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115374.156670:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d316f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115374.156714:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8827840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308222464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115374.156740:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115374.156767:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd06b5240 going to sleep for 11 seconds 00000100:00100000:3.0:1789115374.156822:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308222464 00000100:00100000:3.0:1789115374.156827:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308222464 00000100:00100000:3.0:1789115374.156858:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789115374.156865:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308222464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115374.157135:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308222464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (393us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789115374.157143:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789115374.157355:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8827840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308222464:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789115374.157377:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789115374.157418:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3168 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d316f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115374.157427:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d316f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115374.308539:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115375.278845:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789115375.278873:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff973840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308222592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789115375.278971:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115375.279207:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308222592 00000100:00100000:1.0:1789115375.279216:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308222592 00000100:00100000:1.0:1789115375.279290:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789115375.279299:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308222592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789115375.279337:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115375.279477:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308222592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 178us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115375.279484:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789115375.279782:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789115375.284169:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff973840 x1876023308222592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115375.284206:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff973840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308222592:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789115375.334834:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789115375.995586:0:8507:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3e92e7a0 20000000:00000080:1.0:1789115375.995614:0:8507:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dfcfbf58c00 uarg=0000000000000000 20000000:01000000:1.0:1789115375.995663:0:8507:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789115375.995671:0:8507:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789115375.995677:0:8507:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789115375.998365:0:8508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789115375.998489:0:8507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789115376.004772:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789115376.004835:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789115376.004895:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789115376.004917:0:8507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789115376.004939:0:8507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115376.004959:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfd021c5e00/0xa47abda6516d2eeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2ee4 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115376.004968:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcc1521000/0xa47abda6516d2f4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d2f46 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115376.004989:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3011 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115376.005001:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d30d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39e3 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115376.005009:0:8507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115376.005052:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d30d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39e3 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115376.005081:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d30d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39e3 expref: 9 pid: 5846 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115376.005097:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc331680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876023308222720:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115376.005238:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d3011 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115376.005248:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3018 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d3011 expref: 18 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115376.005256:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876023308222848:0@lo:104: 00000100:00100000:0.0:1789115376.005305:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789115376.005359:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcc1521000/0xa47abda6516d2f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2f46 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115376.005367:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcc1521000/0xa47abda6516d2f4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2f46 expref: 18 pid: 5846 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115376.005408:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876023308222976:0@lo:104: 00000100:00100000:0.0:1789115376.005434:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789115376.005465:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfd021c5e00/0xa47abda6516d2eeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d2ee4 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115376.005473:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfd021c5e00/0xa47abda6516d2eeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d2ee4 expref: 18 pid: 5846 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115376.005482:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876023308223104:0@lo:104: 00000100:00100000:0.0:1789115376.005502:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8980c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789115376.005791:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789115376.005814:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115376.005827:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308222848 00000100:00100000:2.0:1789115376.005833:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308222848 00000100:00100000:2.0:1789115376.005873:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308222976 00000100:00100000:2.0:1789115376.005876:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308222976 00000100:00100000:2.0:1789115376.005886:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308223104 00000100:00100000:2.0:1789115376.005888:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308223104 00000100:00100000:2.0:1789115376.005901:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789115376.005909:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc333c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+5:8507:x1876023308222848:12345-0@lo:104: 00010000:00010000:2.0:1789115376.005924:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3018 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115376.005989:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789115376.005995:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc333c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+5:8507:x1876023308222848:12345-0@lo:104: Request processed in 88us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115376.006003:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789115376.006020:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789115376.006027:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfccf0da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+4:8507:x1876023308222976:12345-0@lo:104: 00010000:00010000:2.0:1789115376.006035:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2f4d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115376.014713:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789115376.014742:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfccf0da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+4:8507:x1876023308222976:12345-0@lo:104: Request processed in 8706us (9298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115376.014757:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789115376.014841:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789115376.014859:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+3:8507:x1876023308223104:12345-0@lo:104: 00010000:00010000:2.0:1789115376.014877:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d2ee4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2eeb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115376.020259:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876023308222848:0@lo:104: 00000100:00100000:0.0:1789115376.020279:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876023308222976:0@lo:104: 00000100:00100000:0.0:1789115376.020289:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876023308223104:0@lo:104: 00000100:00100000:1.0:1789115376.022538:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115376.023093:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc331680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876023308222720:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115376.023139:0:8507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023337:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789115376.023347:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3018 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023356:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95dc00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115376.023359:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d3018 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023370:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d3018 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115376.023378:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d3018 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115376.023421:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789115376.023447:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789115376.023452:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2f4d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023459:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95c600 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115376.023462:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2f4d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023469:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2f4d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115376.023476:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2f4d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115376.023481:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789115376.023534:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f4d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023540:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115376.023573:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f4d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023580:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c600/0xa47abda6516d2f46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2f4d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023606:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115376.023609:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d2ee4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d2eeb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023626:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ee00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115376.023629:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d2ee4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d2eeb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023637:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d2ee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d2eeb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115376.023643:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d2ee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d2eeb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115376.023648:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789115376.023664:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d2ee4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2eeb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023669:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115376.023686:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d2ee4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2eeb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023693:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d2ee4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d2eeb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023703:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115376.023705:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115376.023707:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115376.023726:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288272512 00000100:00100000:3.0:1789115376.023732:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288272512 00010000:00010000:3.0:1789115376.023770:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d30d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39e3 expref: 10 pid: 5846 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115376.023776:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308223232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789115376.023803:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1789115376.023819:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2352:x1876023288272512:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115376.023833:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115376.023838:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d30d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39e3 expref: 10 pid: 5846 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115376.023843:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789115376.023851:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d30d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39e3 expref: 10 pid: 5846 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023868:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d30d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39e3 expref: 10 pid: 5846 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.023880:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115376.023908:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308223232 00000100:00100000:0.0:1789115376.023912:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308223232 00010000:00010000:0.0:1789115376.023927:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcc1521000/0xa47abda6516d2f4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2f46 expref: 19 pid: 5846 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115376.023930:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:2352:x1876023288272512:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 113us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115376.023938:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1789115376.023951:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789115376.023957:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc331680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3308:x1876023308223232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789115376.023973:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115376.023978:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcc1521000/0xa47abda6516d2f4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2f46 expref: 19 pid: 5846 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115376.023979:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308223360:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789115376.023986:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcc1521000/0xa47abda6516d2f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2f46 expref: 19 pid: 5846 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115376.023997:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc1521000/0xa47abda6516d2f4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2f46 expref: 19 pid: 5846 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115376.024007:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789115376.024007:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115376.024032:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc331680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d846835-79f9-4361-81d5-b56fc2e9378a+18:3308:x1876023308223232:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115376.024035:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308223360 00000100:00100000:3.0:1789115376.024038:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308223360 00000100:00100000:0.0:1789115376.024038:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1789115376.024051:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfd021c5e00/0xa47abda6516d2eeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2ee4 expref: 18 pid: 5846 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115376.024078:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308223232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789115376.024082:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789115376.024088:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:3305:x1876023308223360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789115376.024095:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115376.024099:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfd021c5e00/0xa47abda6516d2eeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d2ee4 expref: 18 pid: 5846 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.024119:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfd021c5e00/0xa47abda6516d2eeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d2ee4 expref: 18 pid: 5846 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.024129:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfd021c5e00/0xa47abda6516d2eeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d2ee4 expref: 18 pid: 5846 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.024139:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115376.024298:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:3305:x1876023308223360:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115376.024307:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789115376.024504:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3018 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.024512:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115376.024523:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3018 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.024530:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcda95dc00/0xa47abda6516d3011 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3018 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.024545:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115376.024548:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115376.024550:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115376.024687:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308223488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789115376.024724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115376.024803:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308223488 00000100:00100000:3.0:1789115376.024808:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308223488 00010000:00010000:3.0:1789115376.025043:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3018 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d3011 expref: 17 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115376.025085:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789115376.025093:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff970b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:3306:x1876023308223488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789115376.025115:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115376.025120:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3018 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d3011 expref: 17 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.025131:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d3011 expref: 17 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.025144:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3018 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d3011 expref: 17 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.025156:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.025165:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115376.025219:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308223360:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789115376.025408:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.025416:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.025424:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.025432:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.025438:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ea00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115376.025442:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.025462:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.025481:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115376.025492:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115376.025541:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff970b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+16:3306:x1876023308223488:12345-0@lo:103:ldlm_bl.0 Request processed in 448us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115376.025548:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789115376.025724:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308223488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789115376.025777:0:8507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115376.025786:0:8507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115376.025792:0:8507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3176 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115376.031744:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789115376.031766:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+3:8507:x1876023308223104:12345-0@lo:104: Request processed in 16911us (25944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115376.031782:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789115376.032051:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115376.294448:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc88270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308223872:0@lo:400:kworker.0 00000100:00100000:2.0:1789115376.294700:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308223616:0@lo:400:kworker.0 00000100:00100000:2.0:1789115376.294744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115376.294809:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8827840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308224128:0@lo:400:kworker.0 00000100:00100000:2.0:1789115376.294840:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308224000:0@lo:400:kworker.0 00000100:00100000:2.0:1789115376.294866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115376.294919:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308223616 00000100:00100000:2.0:1789115376.294927:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308223616 00000100:00100000:2.0:1789115376.294981:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308224000 00000100:00100000:2.0:1789115376.294985:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308224000 00000100:00100000:2.0:1789115376.295017:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789115376.295026:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8824b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308223616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115376.295091:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8824b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308223616:12345-0@lo:400:kworker.0 Request processed in 67us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115376.295115:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789115376.295134:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789115376.295141:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308224000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115376.295246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115376.295291:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308223744:0@lo:400:kworker.0 00000100:00100000:0.0:1789115376.295327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115376.297817:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308224000:12345-0@lo:400:kworker.0 Request processed in 2663us (2936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115376.297836:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789115376.297872:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308223744 00000100:00100000:2.0:1789115376.297881:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308223744 00000100:00100000:2.0:1789115376.297921:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789115376.297929:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc330780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308223744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115376.297993:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc330780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308223744:12345-0@lo:400:kworker.0 Request processed in 65us (2665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115376.298000:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789115376.298029:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115376.298051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115376.298147:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308223616:0@lo:400:kworker.0 00000100:00100000:0.0:1789115376.299043:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308224000:0@lo:400:kworker.0 00000100:00100000:0.0:1789115376.299422:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308223744:0@lo:400:kworker.0 00000100:00100000:0.0:1789115376.299457:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308223872 00000100:00100000:0.0:1789115376.299464:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308223872 00000100:00100000:0.0:1789115376.299517:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308224128 00000100:00100000:0.0:1789115376.299521:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308224128 00000100:00100000:0.0:1789115376.299683:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789115376.299693:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc330f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308223872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115376.299776:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc330f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308223872:12345-0@lo:400:kworker.0 Request processed in 85us (4529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115376.299783:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789115376.299799:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789115376.299806:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308224128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115376.299838:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308224128:12345-0@lo:400:kworker.0 Request processed in 33us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115376.299844:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789115376.300683:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc8827840 x1876023308224128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115376.300702:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8827840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308224128:0@lo:400:kworker.0 00000100:00080000:2.0:1789115376.300736:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789115376.301740:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc88270c0 x1876023308223872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115376.301758:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc88270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308223872:0@lo:400:kworker.0 00010000:00010000:3.0:1789115376.356682:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115376.803848:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308224256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789115376.803965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115376.804841:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308224256 00000100:00100000:0.0:1789115376.804852:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308224256 00000100:00100000:0.0:1789115376.804925:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789115376.804936:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8827840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308224256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115376.804998:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115376.805488:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8827840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308224256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 552us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115376.805497:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789115376.805843:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc332580 x1876023308224256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115376.805868:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308224256:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789115377.379752:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115377.706014:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115377.709181:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288272640 00000100:00100000:0.0:1789115377.709199:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288272640 00000100:00100000:0.0:1789115377.709282:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:0.0:1789115377.709295:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:5593:x1876023288272640:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789115377.709315:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115377.709339:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d317d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3a22 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115377.709368:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d317d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a22 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115377.709402:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d317d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a22 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115377.709411:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28ea00, rc 0) 00000100:00100000:0.0:1789115377.709500:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5593:x1876023288272640:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 208us (3500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115377.709507:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:2.0:1789115377.728527:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115377.728722:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288272768 00000100:00100000:0.0:1789115377.728732:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288272768 00000100:00100000:0.0:1789115377.728797:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:0.0:1789115377.728808:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5593:x1876023288272768:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789115377.729185:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5593:x1876023288272768:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 378us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115377.729207:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:0.0:1789115377.737120:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115377.737246:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288272896 00000100:00100000:2.0:1789115377.737255:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288272896 00000100:00100000:2.0:1789115377.737312:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:2.0:1789115377.737321:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5593:x1876023288272896:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115377.737632:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:5593:x1876023288272896:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 311us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115377.737640:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:0.0:1789115377.754331:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115377.754578:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288273024 00000100:00100000:1.0:1789115377.754589:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288273024 00000100:00100000:1.0:1789115377.754655:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:1.0:1789115377.754665:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:6123:x1876023288273024:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789115377.754967:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:6123:x1876023288273024:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 303us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115377.754975:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:2.0:1789115377.770917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115377.771051:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288273152 00000100:00100000:0.0:1789115377.771073:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288273152 00000100:00100000:0.0:1789115377.771137:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:0.0:1789115377.771148:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:6123:x1876023288273152:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789115377.771498:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:6123:x1876023288273152:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 352us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115377.771508:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 175 10000000:01000000:2.0:1789115377.829581:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789115377.829592:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcff92b000 from 4 10000000:01000000:2.0:1789115377.829599:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789115377.829656:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115377.829755:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115377.829769:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115377.829800:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308224384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789115377.829953:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115377.830071:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411180 going to sleep for 11 seconds 00000100:00100000:3.0:1789115377.833441:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308224384 00000100:00100000:3.0:1789115377.833472:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308224384 00000100:00100000:3.0:1789115377.833545:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789115377.833556:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308224384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115377.833576:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115377.833597:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d318b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d3184 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115377.833628:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d318b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d3184 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115377.833639:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d318b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3184 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115377.833649:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c4c00, rc 0) 00000100:00100000:3.0:1789115377.833754:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308224384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (3801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115377.833778:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789115377.834448:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308224384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789115377.834472:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d318b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115377.834492:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d318b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115377.834574:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308224512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115377.834621:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115377.834676:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411180 going to sleep for 11 seconds 00000100:00100000:3.0:1789115377.834873:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308224512 00000100:00100000:3.0:1789115377.834974:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308224512 00000100:00100000:3.0:1789115377.835017:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789115377.835309:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308224512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115377.835664:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308224512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 638us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115377.835672:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789115377.835964:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308224512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115377.836012:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff972d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308224640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115377.836187:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115377.836226:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1158cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115377.836272:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308224640 00000100:00100000:0.0:1789115377.836278:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308224640 00000100:00100000:0.0:1789115377.836308:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789115377.836315:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308224640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789115377.836520:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308224640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115377.836526:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789115377.836612:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff972d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308224640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115377.837360:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff972d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8538:1876023308224768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115377.837461:0:8538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115377.837489:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcedacf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115377.837613:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308224768 00000100:00100000:0.0:1789115377.837619:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308224768 00000100:00100000:0.0:1789115377.837652:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789115377.837659:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:8538:x1876023308224768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789115377.837973:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:8538:x1876023308224768:12345-0@lo:502:llog_process_th.0 Request processed in 313us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115377.837980:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789115377.838597:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff972d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8538:1876023308224768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789115377.838632:0:8538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789115377.838644:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115377.838647:0:8538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789115377.838655:0:8538:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dfcff92b000 00000020:00000080:2.0:1789115377.838658:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789115377.838763:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8538:1876023308224896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115377.838829:0:8538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115377.838863:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411240 going to sleep for 11 seconds 00000100:00100000:3.0:1789115377.838981:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308224896 00000100:00100000:3.0:1789115377.838987:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308224896 00000100:00100000:3.0:1789115377.839038:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789115377.839046:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:8538:x1876023308224896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789115377.839263:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:8538:x1876023308224896:12345-0@lo:502:llog_process_th.0 Request processed in 217us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115377.839270:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789115377.839497:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8538:1876023308224896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789115377.839517:0:8538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115377.839522:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115377.839523:0:8538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789115377.839527:0:8538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789115377.847292:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789115377.847339:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789115377.847354:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d318b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115377.847369:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d318b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115377.847417:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789115377.847420:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcd8ba8800 from 4 10000000:01000000:3.0:1789115377.847423:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789115377.847471:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115377.847494:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115377.847505:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115377.847537:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308225024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789115377.847629:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115377.847680:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789115377.847710:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308225024 00000100:00100000:3.0:1789115377.847717:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308225024 00000100:00100000:3.0:1789115377.847767:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789115377.847776:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308225024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115377.847789:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115377.847803:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3199 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d3192 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115377.847843:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d3192 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115377.847854:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3192 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115377.847863:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c5c00, rc 0) 00000100:00100000:3.0:1789115377.847922:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308225024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115377.847929:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789115377.847989:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308225024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115377.848003:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3199 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115377.848012:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3199 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115377.848267:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308225152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115377.848300:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115377.848315:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789115377.848328:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308225152 00000100:00100000:3.0:1789115377.848332:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308225152 00000100:00100000:3.0:1789115377.848353:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789115377.848359:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308225152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115377.848670:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308225152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115377.848678:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789115377.848712:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308225152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115377.848743:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308225280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115377.848788:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115377.848803:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789115377.848815:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308225280 00000100:00100000:3.0:1789115377.848818:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308225280 00000100:00100000:3.0:1789115377.848841:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789115377.848847:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308225280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115377.849015:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308225280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115377.849644:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789115377.849698:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308225280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789115377.860628:0:8540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8540:1876023308225408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789115377.860767:0:8540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115377.860832:0:8540:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd9719300 going to sleep for 11 seconds 00000100:00100000:2.0:1789115377.861032:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308225408 00000100:00100000:2.0:1789115377.861041:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308225408 00000100:00100000:2.0:1789115377.861115:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789115377.861125:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:8540:x1876023308225408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115377.861407:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:8540:x1876023308225408:12345-0@lo:502:llog_process_th.0 Request processed in 283us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115377.861425:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789115377.862669:0:8540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8540:1876023308225408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789115377.862717:0:8540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789115377.862731:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115377.862734:0:8540:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789115377.862744:0:8540:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dfcd8ba8800 00000020:00000080:0.0:1789115377.862747:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789115377.862849:0:8540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8540:1876023308225536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789115377.862912:0:8540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115377.862959:0:8540:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd9719300 going to sleep for 11 seconds 00000100:00100000:2.0:1789115377.864378:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308225536 00000100:00100000:2.0:1789115377.864415:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308225536 00000100:00100000:2.0:1789115377.864470:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789115377.864479:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+18:8540:x1876023308225536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115377.864842:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+18:8540:x1876023308225536:12345-0@lo:502:llog_process_th.0 Request processed in 362us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115377.864850:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789115377.864978:0:8540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8540:1876023308225536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789115377.865016:0:8540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115377.865035:0:8540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115377.865038:0:8540:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789115377.865043:0:8540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789115377.865735:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789115377.865762:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789115377.865774:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3199 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115377.865786:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3199 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115377.865798:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789115377.865800:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcc65aa800 from 4 10000000:01000000:3.0:1789115377.865803:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789115377.865837:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115377.865845:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115377.865852:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115377.865876:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308225664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789115377.865928:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115377.865973:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115377.866364:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308225664 00000100:00100000:0.0:1789115377.866371:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308225664 00000100:00100000:0.0:1789115377.866446:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789115377.866455:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308225664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789115377.866467:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115377.866481:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d31a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d31a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115377.866503:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d31a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d31a0 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115377.866515:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d31a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d31a0 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115377.866524:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e400, rc 0) 00000100:00100000:0.0:1789115377.866650:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308225664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115377.866670:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789115377.871873:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308225664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115377.871911:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d31a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115377.871925:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d31a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115377.872059:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff971e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308225792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115377.872148:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115377.872194:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfcfaecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115377.874361:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308225792 00000100:00100000:0.0:1789115377.874377:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308225792 00000100:00100000:0.0:1789115377.874468:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789115377.874479:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308225792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789115377.874868:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308225792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 389us (2718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115377.874877:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789115377.875067:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff971e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308225792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115377.875138:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308225920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115377.875192:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115377.875226:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd84276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115377.875244:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308225920 00000100:00100000:2.0:1789115377.875248:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308225920 00000100:00100000:2.0:1789115377.875273:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789115377.875280:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308225920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115377.875467:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308225920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115377.875474:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789115377.875512:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308225920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789115377.878280:0:8542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc333c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8542:1876023308226048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789115377.878406:0:8542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115377.878468:0:8542:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd9719300 going to sleep for 11 seconds 00000100:00100000:1.0:1789115377.878589:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308226048 00000100:00100000:1.0:1789115377.878597:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308226048 00000100:00100000:1.0:1789115377.878646:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789115377.878656:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:8542:x1876023308226048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115377.878924:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:8542:x1876023308226048:12345-0@lo:502:llog_process_th.0 Request processed in 269us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115377.878933:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789115377.878992:0:8542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc333c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8542:1876023308226048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789115377.879043:0:8542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115377.879063:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115377.879066:0:8542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789115377.879075:0:8542:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dfcc65aa800 00000020:00000080:1.0:1789115377.879078:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789115377.880368:0:8542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9703c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8542:1876023308226176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115377.880475:0:8542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115377.880519:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308226176 00000100:00100000:1.0:1789115377.880525:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308226176 00000100:00100000:1.0:1789115377.880563:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789115377.880570:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:8542:x1876023308226176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115377.881434:0:8542:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfcfaecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789115377.883465:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:8542:x1876023308226176:12345-0@lo:502:llog_process_th.0 Request processed in 2881us (2976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115377.883481:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789115377.885148:0:8542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9703c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:8542:1876023308226176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789115377.885205:0:8542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789115377.885215:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115377.885217:0:8542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789115377.885223:0:8542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789115377.885457:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789115377.885479:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789115377.885491:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d31a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115377.885511:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d31a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115378.414342:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115379.183534:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115379.183589:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115379.183622:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115379.183681:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288273536 00000100:00100000:2.0:1789115379.183690:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288273536 00000100:00100000:2.0:1789115379.183758:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1789115379.183768:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8824f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288273536:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115379.183841:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8824f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288273536:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 75us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115379.183850:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1789115379.183874:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288273408 00000100:00100000:2.0:1789115379.183878:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288273408 00000100:00100000:2.0:1789115379.183909:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1789115379.183915:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288273408:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115379.183947:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288273408:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 32us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115379.183953:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00080000:2.0:1789115379.183969:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789115379.183973:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789115379.185583:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288273280 00000100:00100000:0.0:1789115379.185599:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288273280 00000100:00100000:0.0:1789115379.185666:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:0.0:1789115379.185676:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288273280:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115379.185750:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288273280:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 76us (2240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115379.185758:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:2.0:1789115379.186453:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115379.188898:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288273664 00000100:00100000:0.0:1789115379.188914:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288273664 00000100:00100000:0.0:1789115379.190238:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1789115379.190261:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8826d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288273664:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115379.190358:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8826d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288273664:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 105us (3909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115379.190367:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00080000:0.0:1789115379.190428:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789115379.431781:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115380.388009:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308226304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789115380.388133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115380.388798:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308226304 00000100:00100000:1.0:1789115380.388808:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308226304 00000100:00100000:1.0:1789115380.388929:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789115380.388936:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789115380.388940:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc332940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308226304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789115380.388980:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115380.389060:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc332940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308226304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115380.389156:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789115380.389236:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50ea1c0 x1876023308226304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115380.389259:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308226304:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789115380.451658:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115381.413145:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308226688:0@lo:400:kworker.0 00000100:00100000:2.0:1789115381.413248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115381.413322:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789115381.413329:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308226560:0@lo:400:kworker.0 00000100:00100000:2.0:1789115381.413354:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115381.413374:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc0861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308227072:0@lo:400:kworker.0 00000100:00100000:2.0:1789115381.413421:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115381.413461:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308226688 00000100:00100000:2.0:1789115381.413468:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308226688 00000100:00100000:2.0:1789115381.413526:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308226560 00000100:00100000:1.0:1789115381.413721:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308226432:0@lo:400:kworker.0 00000100:00100000:1.0:1789115381.413761:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115381.413789:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc88270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308226944:0@lo:400:kworker.0 00000100:00100000:1.0:1789115381.413814:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115381.413835:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789115381.413840:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308226816:0@lo:400:kworker.0 00000100:00100000:1.0:1789115381.413863:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115381.413899:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308226432 00000100:00100000:1.0:1789115381.413903:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308226432 00000100:00100000:1.0:1789115381.413937:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789115381.413946:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308226432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115381.413997:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308226432:12345-0@lo:400:kworker.0 Request processed in 52us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115381.414005:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789115381.414103:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308226944 00000100:00100000:1.0:1789115381.414107:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308226944 00000100:00100000:1.0:1789115381.414129:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789115381.414136:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308226688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115381.414187:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308226688:12345-0@lo:400:kworker.0 Request processed in 51us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115381.414194:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789115381.414208:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789115381.414215:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308226944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115381.414243:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308226944:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115381.414250:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789115381.414269:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308227072 00000100:00100000:1.0:1789115381.414272:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308227072 00000100:00100000:1.0:1789115381.414301:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308226816 00000100:00100000:1.0:1789115381.414304:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308226816 00000100:00100000:1.0:1789115381.414325:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789115381.414332:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc0852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308227072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115381.414378:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc0852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308227072:12345-0@lo:400:kworker.0 Request processed in 48us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115381.414416:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789115381.414429:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789115381.414435:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff970f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308226816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115381.414464:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff970f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308226816:12345-0@lo:400:kworker.0 Request processed in 30us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115381.414470:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789115381.414508:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc0861c0 x1876023308227072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115381.414524:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc0861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308227072:0@lo:400:kworker.0 00000100:00100000:1.0:1789115381.414856:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308226688:0@lo:400:kworker.0 00000100:00100000:2.0:1789115381.415073:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308226560 00000100:00100000:2.0:1789115381.415105:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789115381.415112:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc087840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308226560:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789115381.417895:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789115381.417910:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789115381.426066:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f0b40 x1876023308226816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115381.426091:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308226816:0@lo:400:kworker.0 00000100:00100000:1.0:1789115381.428153:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308226432:0@lo:400:kworker.0 00000100:00100000:1.0:1789115381.428185:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc88270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308226944:0@lo:400:kworker.0 00000100:00100000:3.0:1789115381.436297:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc087840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308226560:12345-0@lo:400:kworker.0 Request processed in 21171us (22927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115381.436329:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789115381.436792:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308226560:0@lo:400:kworker.0 00010000:00010000:2.0:1789115381.475889:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115381.923695:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789115381.923722:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc331e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308227200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789115381.923806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115381.923999:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308227200 00000100:00100000:2.0:1789115381.924007:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308227200 00000100:00100000:2.0:1789115381.924075:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789115381.924096:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc333c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308227200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789115381.924136:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115381.924189:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc333c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308227200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115381.924197:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789115381.924240:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc331e00 x1876023308227200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115381.924262:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc331e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308227200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789115382.501761:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115383.524197:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115384.302711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115384.302746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115384.302772:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115384.302799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115384.302839:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288273792 00000100:00100000:0.0:1789115384.302850:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288273792 00000100:00100000:0.0:1789115384.302908:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:0.0:1789115384.302920:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2350:x1876023288273792:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115384.304403:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2350:x1876023288273792:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 1462us (1678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115384.304418:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:0.0:1789115384.304473:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288274048 00000100:00100000:0.0:1789115384.304481:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288274048 00000100:00100000:0.0:1789115384.304529:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288274176 00000100:00100000:0.0:1789115384.304532:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288274176 00000100:00100000:0.0:1789115384.306792:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1789115384.306804:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc332580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+5:2350:x1876023288274048:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115384.306886:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc332580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+5:2350:x1876023288274048:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 84us (4139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115384.306894:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1789115384.306912:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1789115384.306920:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+5:2350:x1876023288274176:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115384.306946:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+5:2350:x1876023288274176:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (4146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115384.306952:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1789115384.307042:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288273920 00000100:00100000:0.0:1789115384.307051:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288273920 00000100:00100000:0.0:1789115384.307083:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1789115384.307089:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc331e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2350:x1876023288273920:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115384.307120:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc331e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2350:x1876023288273920:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 32us (4347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115384.307126:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00080000:3.0:1789115384.312102:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789115384.312112:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789115384.312115:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789115384.550779:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115385.514916:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308227328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789115385.515014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115385.517703:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308227328 00000100:00100000:3.0:1789115385.517719:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308227328 00000100:00100000:3.0:1789115385.517894:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789115385.517907:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308227328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789115385.517953:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115385.518050:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308227328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (3048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115385.518057:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789115385.518125:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789115385.518193:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50eb480 x1876023308227328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115385.518218:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308227328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789115385.574989:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789115385.675906:0:8806:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1789115386.543133:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308227584:0@lo:400:kworker.0 00000100:00100000:3.0:1789115386.543220:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115386.543273:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308228096:0@lo:400:kworker.0 00000100:00100000:3.0:1789115386.543295:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115386.543324:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115386.543329:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308227712:0@lo:400:kworker.0 00000100:00100000:3.0:1789115386.543368:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115386.543422:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308227840:0@lo:400:kworker.0 00000100:00100000:3.0:1789115386.543427:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308227584 00000100:00100000:3.0:1789115386.543436:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308227584 00000100:00100000:0.0:1789115386.543462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115386.543485:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308227712 00000100:00100000:3.0:1789115386.543489:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308227712 00000100:00100000:0.0:1789115386.543492:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789115386.543502:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308227456:0@lo:400:kworker.0 00000100:00100000:3.0:1789115386.543531:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789115386.543539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115386.543543:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308227584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115386.543584:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308227968:0@lo:400:kworker.0 00000100:00100000:3.0:1789115386.543602:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308227584:12345-0@lo:400:kworker.0 Request processed in 62us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115386.543611:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789115386.543618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115386.543629:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308227968 00000100:00100000:3.0:1789115386.543633:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308227968 00000100:00100000:0.0:1789115386.543649:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308228096 00000100:00100000:3.0:1789115386.543653:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789115386.543656:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308228096 00000100:00100000:3.0:1789115386.543661:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308227712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115386.543692:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308227712:12345-0@lo:400:kworker.0 Request processed in 32us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115386.543697:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308227840 00000100:00100000:3.0:1789115386.543699:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789115386.543703:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308227840 00000100:00100000:3.0:1789115386.543714:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789115386.543723:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308227968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115386.543735:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789115386.543745:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd34212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308228096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115386.543753:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308227968:12345-0@lo:400:kworker.0 Request processed in 31us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115386.543760:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789115386.543779:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789115386.543791:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308227840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115386.543792:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd34212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308228096:12345-0@lo:400:kworker.0 Request processed in 46us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115386.543804:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789115386.543826:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308227840:12345-0@lo:400:kworker.0 Request processed in 39us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115386.543833:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789115386.543863:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789115386.543867:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115386.543902:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308227968:0@lo:400:kworker.0 00010000:00080000:3.0:1789115386.543914:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50e92c0 x1876023308227840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115386.543931:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308227840:0@lo:400:kworker.0 00000100:00100000:0.0:1789115386.543946:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308227456 00000100:00100000:0.0:1789115386.543951:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308227456 00000100:00100000:3.0:1789115386.543978:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308227712:0@lo:400:kworker.0 00000100:00100000:0.0:1789115386.543987:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789115386.543991:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308227584:0@lo:400:kworker.0 00000100:00100000:0.0:1789115386.544008:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308227456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115386.544047:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308227456:12345-0@lo:400:kworker.0 Request processed in 53us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115386.544060:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00010000:00080000:3.0:1789115386.545460:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50eb480 x1876023308228096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115386.545478:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308228096:0@lo:400:kworker.0 00000100:00100000:3.0:1789115386.545547:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308227456:0@lo:400:kworker.0 00010000:00010000:3.0:1789115386.595542:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115387.049475:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789115387.049504:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308228224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789115387.049578:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115387.049780:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308228224 00000100:00100000:0.0:1789115387.049790:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308228224 00000100:00100000:0.0:1789115387.049849:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789115387.049861:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff971a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308228224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115387.049903:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115387.049961:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff971a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308228224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115387.049969:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789115387.050070:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcd35f7c00 x1876023308228224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115387.050090:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308228224:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789115387.621428:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115388.643628:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115389.418072:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115389.418125:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115389.418225:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288274304 00000100:00100000:0.0:1789115389.418235:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288274304 00000100:00100000:0.0:1789115389.418295:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:0.0:1789115389.418307:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288274304:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115389.418415:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288274304:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 110us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115389.418424:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:1.0:1789115389.419741:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288274432 00000100:00100000:1.0:1789115389.419754:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288274432 00000100:00100000:1.0:1789115389.419840:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:1.0:1789115389.419851:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288274432:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115389.420011:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288274432:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 162us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115389.420020:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00080000:3.0:1789115389.420093:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115389.426065:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115389.426113:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115389.426441:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288274560 00000100:00100000:0.0:1789115389.426451:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288274560 00000100:00100000:1.0:1789115389.426990:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288274688 00000100:00100000:1.0:1789115389.426996:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288274688 00000100:00100000:1.0:1789115389.427070:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1789115389.427081:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+5:2349:x1876023288274688:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:1.0:1789115389.427122:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d30ea 00000100:00080000:1.0:1789115389.427141:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8dfcc5def000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789115389.427183:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789115389.427582:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1789115389.427592:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2349:x1876023288274560:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:0.0:1789115389.427615:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d30e3 00000100:00080000:0.0:1789115389.427622:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8dfcc5dee000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789115389.427650:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:2.0:1789115389.429761:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789115389.429773:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789115389.429834:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115389.429874:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115389.430423:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+2:2349:x1876023288274688:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 3335us (4300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115389.430810:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+2:2349:x1876023288274560:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 3217us (4757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115389.431630:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1789115389.433917:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00010000:00010000:1.0:1789115389.668648:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115390.635562:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789115390.635591:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc085e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308228352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789115390.635678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115390.637574:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308228352 00000100:00100000:2.0:1789115390.637588:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308228352 00000100:00100000:2.0:1789115390.637663:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789115390.637673:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc0843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308228352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789115390.637713:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115390.637801:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc0843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308228352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115390.637808:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789115390.637829:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789115390.637864:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc085e00 x1876023308228352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115390.637888:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc085e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308228352:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789115390.712141:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789115390.789596:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6dbf7574-92fb-4b89-af78-41319f924699 00000020:00000080:0.0:1789115390.789606:0:6724:0:(genops.c:885:class_export_put()) final put ffff8dfcc5deb800/6dbf7574-92fb-4b89-af78-41319f924699 00000020:00000080:0.0:1789115390.789639:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcc5deb800/6dbf7574-92fb-4b89-af78-41319f924699 for lustre-OST0000 00000020:00000080:0.0:1789115390.789690:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcc5dee000 for lustre-OST0000 00000100:00100000:0.0:1789115391.651985:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308228864:0@lo:400:kworker.0 00000100:00100000:0.0:1789115391.652083:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115391.652152:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789115391.652159:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308228480:0@lo:400:kworker.0 00000100:00100000:0.0:1789115391.652188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115391.652212:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaadb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308228992:0@lo:400:kworker.0 00000100:00100000:0.0:1789115391.652238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115391.652286:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308228608:0@lo:400:kworker.0 00000100:00100000:0.0:1789115391.652311:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115391.652329:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308229120:0@lo:400:kworker.0 00000100:00100000:0.0:1789115391.652350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115391.652367:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789115391.652372:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308228736:0@lo:400:kworker.0 00000100:00100000:0.0:1789115391.652414:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115391.652466:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308228480 00000100:00100000:0.0:1789115391.652475:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308228480 00000100:00100000:0.0:1789115391.652526:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789115391.652537:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308228480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115391.652593:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308228480:12345-0@lo:400:kworker.0 Request processed in 57us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115391.652600:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789115391.652667:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308228992 00000100:00100000:0.0:1789115391.652671:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308228992 00000100:00100000:0.0:1789115391.652703:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308228608 00000100:00100000:0.0:1789115391.652705:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308228608 00000100:00100000:0.0:1789115391.652717:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308228736 00000100:00100000:0.0:1789115391.652719:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308228736 00000100:00100000:0.0:1789115391.653340:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789115391.653352:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308228992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115391.653437:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308228992:12345-0@lo:400:kworker.0 Request processed in 89us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115391.653444:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789115391.653458:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789115391.653464:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308228608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115391.653495:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308228608:12345-0@lo:400:kworker.0 Request processed in 32us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115391.653500:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789115391.653510:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789115391.653515:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaada940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308228736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115391.653538:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaada940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308228736:12345-0@lo:400:kworker.0 Request processed in 24us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115391.653543:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789115391.653602:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308228736:0@lo:400:kworker.0 00000100:00100000:0.0:1789115391.653615:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308228608:0@lo:400:kworker.0 00000100:00100000:0.0:1789115391.653645:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308228480:0@lo:400:kworker.0 00000100:00100000:0.0:1789115391.653655:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaadb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308228992:0@lo:400:kworker.0 00000100:00100000:2.0:1789115391.653871:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308228864 00000100:00100000:2.0:1789115391.653878:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308228864 00000100:00100000:2.0:1789115391.653918:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308229120 00000100:00100000:2.0:1789115391.653922:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308229120 00000100:00100000:2.0:1789115391.653944:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789115391.653951:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaadbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308228864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115391.654020:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaadbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308228864:12345-0@lo:400:kworker.0 Request processed in 69us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115391.654032:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789115391.654047:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789115391.654053:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaada580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308229120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115391.654091:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaada580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308229120:12345-0@lo:400:kworker.0 Request processed in 38us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115391.654097:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789115391.654117:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789115391.654122:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789115391.654145:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcdaad9a40 x1876023308229120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115391.654158:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308229120:0@lo:400:kworker.0 00010000:00080000:2.0:1789115391.654190:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcd35f7c00 x1876023308228864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115391.654202:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308228864:0@lo:400:kworker.0 00010000:00010000:3.0:1789115391.715938:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115392.168600:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789115392.175858:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaadb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308229248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789115392.175948:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115392.176297:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308229248 00000100:00100000:3.0:1789115392.176308:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308229248 00000100:00100000:3.0:1789115392.176364:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789115392.176374:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc085e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308229248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789115392.176441:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115392.176496:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc085e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308229248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115392.176504:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1789115392.176929:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcdaadb0c0 x1876023308229248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115392.176953:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaadb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308229248:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789115392.741498:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789115393.712158:0:9052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing yml_node 00010000:00010000:0.0:1789115393.763495:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789115393.822597:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6dbf7574-92fb-4b89-af78-41319f924699 00000020:00000080:3.0:1789115393.822610:0:7644:0:(genops.c:885:class_export_put()) final put ffff8dfcc5def800/6dbf7574-92fb-4b89-af78-41319f924699 00000020:00000080:3.0:1789115393.822650:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcc5def800/6dbf7574-92fb-4b89-af78-41319f924699 for lustre-OST0001 00000020:00000080:3.0:1789115393.822697:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcc5def000 for lustre-OST0001 00000100:00100000:2.0:1789115394.536781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115394.536835:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115394.536920:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288274816 00000100:00100000:1.0:1789115394.536933:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288274816 00000100:00100000:1.0:1789115394.537023:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:1.0:1789115394.537036:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2352:x1876023288274816:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115394.537111:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2352:x1876023288274816:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115394.537120:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:3.0:1789115394.537245:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288274944 00000100:00100000:3.0:1789115394.537250:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288274944 00000100:00100000:3.0:1789115394.537304:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:3.0:1789115394.537314:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc0870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288274944:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115394.537354:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc0870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288274944:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115394.537362:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00080000:3.0:1789115394.537527:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789115394.793474:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115395.752116:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308229376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789115395.752205:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115395.765022:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308229376 00000100:00100000:0.0:1789115395.765036:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308229376 00000100:00100000:0.0:1789115395.765106:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789115395.765115:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc084f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308229376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789115395.765151:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115395.765241:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc084f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308229376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (13036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115395.765249:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789115395.765344:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf18b40 x1876023308229376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115395.765375:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308229376:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789115395.765560:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789115395.811609:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115396.772222:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308229760:0@lo:400:kworker.0 00000100:00100000:3.0:1789115396.772332:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115396.772344:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf1ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308229504:0@lo:400:kworker.0 00000100:00100000:1.0:1789115396.772459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115396.772515:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308229888:0@lo:400:kworker.0 00000100:00100000:1.0:1789115396.772520:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308229504 00000100:00100000:1.0:1789115396.772530:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308229504 00000100:00100000:2.0:1789115396.772570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115396.772598:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789115396.772609:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308229504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115396.772627:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308229888 00000100:00100000:2.0:1789115396.772635:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308229888 00000100:00100000:1.0:1789115396.772687:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308229504:12345-0@lo:400:kworker.0 Request processed in 79us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115396.772693:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789115396.772711:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789115396.772712:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc085a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308229888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115396.772781:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc085a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308229888:12345-0@lo:400:kworker.0 Request processed in 76us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115396.772789:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789115396.772840:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308229760 00000100:00100000:2.0:1789115396.772844:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308229760 00000100:00100000:2.0:1789115396.772899:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789115396.772906:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308229760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115396.772951:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308229760:12345-0@lo:400:kworker.0 Request processed in 46us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115396.772958:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789115396.773160:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308229632:0@lo:400:kworker.0 00000100:00100000:0.0:1789115396.773199:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789115396.773267:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115396.773611:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308229632 00000100:00100000:2.0:1789115396.773619:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308229632 00000100:00100000:2.0:1789115396.773655:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789115396.773663:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaada1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308229632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115396.773707:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaada1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308229632:12345-0@lo:400:kworker.0 Request processed in 45us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115396.773714:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789115396.773897:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf1ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308229504:0@lo:400:kworker.0 00000100:00100000:0.0:1789115396.773907:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308230016:0@lo:400:kworker.0 00000100:00100000:0.0:1789115396.773945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115396.774089:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308229760:0@lo:400:kworker.0 00000100:00100000:2.0:1789115396.775357:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308230016 00000100:00100000:2.0:1789115396.775371:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308230016 00000100:00100000:2.0:1789115396.775718:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789115396.775748:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaadb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308230016:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789115396.775872:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789115396.775966:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf1b0c0 x1876023308229888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115396.775989:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308229888:0@lo:400:kworker.0 00000100:00100000:1.0:1789115396.781521:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308229632:0@lo:400:kworker.0 00000100:00100000:1.0:1789115396.781558:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308230144:0@lo:400:kworker.0 00000100:00100000:1.0:1789115396.781627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115396.781702:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308230144 00000100:00100000:1.0:1789115396.781708:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308230144 00000100:00100000:1.0:1789115396.781764:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789115396.781773:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308230144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115396.781824:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308230144:12345-0@lo:400:kworker.0 Request processed in 52us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115396.781831:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789115396.781853:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789115396.781873:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf19a40 x1876023308230144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115396.781883:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308230144:0@lo:400:kworker.0 00000100:00100000:2.0:1789115396.784945:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaadb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308230016:12345-0@lo:400:kworker.0 Request processed in 9178us (10976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115396.784963:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789115396.788294:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308230016:0@lo:400:kworker.0 00010000:00010000:0.0:1789115396.838154:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115397.284911:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789115397.285126:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308230272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789115397.285211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115397.285434:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308230272 00000100:00100000:0.0:1789115397.285441:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308230272 00000100:00100000:0.0:1789115397.285487:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789115397.285496:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff971e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308230272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115397.285530:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115397.285693:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff971e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308230272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 197us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115397.285702:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1789115397.285817:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcdaad9a40 x1876023308230272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115397.285836:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308230272:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789115397.860295:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789115398.356858:0:9246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.142 00010000:00010000:1.0:1789115398.887041:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115399.662586:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115399.662697:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115399.662965:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288275200 00000100:00100000:3.0:1789115399.662975:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288275200 00000100:00100000:0.0:1789115399.663064:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288275072 00000100:00100000:3.0:1789115399.663070:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1789115399.663072:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288275072 00000100:00100000:3.0:1789115399.663082:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc086580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288275200:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115399.663112:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:0.0:1789115399.663131:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288275072:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115399.663169:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288275072:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 41us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115399.663179:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc086580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288275200:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 98us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115399.663180:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:3.0:1789115399.663437:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00080000:2.0:1789115399.663501:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789115399.908544:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115400.877535:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789115400.877557:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308230400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789115400.877623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115400.877688:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308230400 00000100:00100000:3.0:1789115400.877695:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308230400 00000100:00100000:3.0:1789115400.877748:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789115400.877758:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308230400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789115400.877790:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115400.877830:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308230400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115400.877837:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789115400.877859:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789115400.877885:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf183c0 x1876023308230400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115400.877917:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308230400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789115400.932281:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789115401.005812:0:9344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.142 00000100:00100000:3.0:1789115401.891803:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308230528:0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.891885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115401.891942:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308231040:0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.891970:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115401.891998:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789115401.892016:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308230912:0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.892046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115401.892076:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308230656:0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.892099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115401.892117:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308231168:0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.892137:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115401.892155:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115401.892160:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308230784:0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.892182:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115401.892214:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308230528 00000100:00100000:3.0:1789115401.892221:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308230528 00000100:00100000:3.0:1789115401.892264:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789115401.892274:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308230528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.892322:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308230528:12345-0@lo:400:kworker.0 Request processed in 50us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115401.892330:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789115401.892362:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308230912 00000100:00100000:3.0:1789115401.892366:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308230912 00000100:00100000:3.0:1789115401.892413:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308231168 00000100:00100000:3.0:1789115401.892416:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308231168 00000100:00100000:3.0:1789115401.892440:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789115401.892446:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf19e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308230912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.892476:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf19e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308230912:12345-0@lo:400:kworker.0 Request processed in 31us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115401.892482:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789115401.892493:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789115401.892498:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308231168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.892539:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308231168:12345-0@lo:400:kworker.0 Request processed in 40us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115401.892545:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789115401.892576:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308231040 00000100:00100000:3.0:1789115401.892579:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308231040 00000100:00100000:3.0:1789115401.892602:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308230656 00000100:00100000:3.0:1789115401.892604:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308230656 00000100:00100000:3.0:1789115401.892614:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308230784 00000100:00100000:3.0:1789115401.892617:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308230784 00000100:00100000:3.0:1789115401.892630:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789115401.892635:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308231040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.892666:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308231040:12345-0@lo:400:kworker.0 Request processed in 30us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115401.892672:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789115401.892683:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789115401.892689:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308230656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.892713:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308230656:12345-0@lo:400:kworker.0 Request processed in 25us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115401.892719:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789115401.892731:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789115401.892737:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308230784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.892761:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308230784:12345-0@lo:400:kworker.0 Request processed in 24us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115401.892766:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1789115401.892805:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf18000 x1876023308230912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115401.892830:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308230912:0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.892842:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308230528:0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.892852:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308231040:0@lo:400:kworker.0 00000100:00080000:3.0:1789115401.892884:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789115401.892902:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789115401.892920:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308230784:0@lo:400:kworker.0 00000100:00100000:3.0:1789115401.892928:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308230656:0@lo:400:kworker.0 00010000:00080000:3.0:1789115401.892937:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf1b0c0 x1876023308231168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115401.892946:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308231168:0@lo:400:kworker.0 00010000:00010000:1.0:1789115401.955539:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115402.407625:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789115402.407656:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308231296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789115402.407728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115402.408094:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308231296 00000100:00100000:0.0:1789115402.408103:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308231296 00000100:00100000:0.0:1789115402.408156:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789115402.408165:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff973840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308231296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115402.408209:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115402.408265:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff973840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308231296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115402.408273:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789115402.408359:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcdaad9a40 x1876023308231296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115402.408409:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308231296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789115402.979486:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789115403.293353:0:9442:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.142 00010000:00010000:2.0:1789115404.003634:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115404.782451:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115404.782487:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288275328 00000100:00100000:3.0:1789115404.782493:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115404.782495:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288275328 00000100:00100000:0.0:1789115404.782536:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:0.0:1789115404.782545:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288275328:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115404.782608:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288275328:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 65us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115404.782612:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:2.0:1789115404.790071:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288275456 00000100:00100000:2.0:1789115404.790085:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288275456 00000100:00100000:2.0:1789115404.790162:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:2.0:1789115404.790173:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288275456:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:1.0:1789115404.790237:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115404.790259:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288275456:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 88us (7764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115404.790267:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000001:02000400:2.0:1789115404.976165:0:9490:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 04:30:02 EDT 2026 00010000:00010000:1.0:1789115405.040587:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115405.989782:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308231424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789115405.989850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115405.990368:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308231424 00000100:00100000:0.0:1789115405.990377:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308231424 00000100:00100000:0.0:1789115405.990444:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789115405.990459:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308231424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789115405.990493:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115405.990541:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308231424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115405.990549:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789115405.991745:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789115405.992106:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcdaad9a40 x1876023308231424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115405.992129:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308231424:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789115406.052759:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115407.011689:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308231936:0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.011754:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115407.011807:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789115407.011814:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308231552:0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.011842:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115407.011878:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308232064:0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.011903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115407.011928:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308231808:0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.011952:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115407.011969:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789115407.011974:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308231680:0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.011995:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115407.012010:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8853840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308232192:0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.012031:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115407.012059:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308231936 00000100:00100000:0.0:1789115407.012066:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308231936 00000100:00100000:0.0:1789115407.012120:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308232192 00000100:00100000:0.0:1789115407.012124:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308232192 00000100:00100000:0.0:1789115407.012146:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789115407.012154:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308231936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.012216:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308231936:12345-0@lo:400:kworker.0 Request processed in 63us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115407.012224:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789115407.012240:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789115407.012245:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308232192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.012273:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308232192:12345-0@lo:400:kworker.0 Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115407.012278:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789115407.012295:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308231552 00000100:00100000:0.0:1789115407.012298:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308231552 00000100:00100000:0.0:1789115407.012323:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789115407.012329:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308231552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.012357:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308231552:12345-0@lo:400:kworker.0 Request processed in 28us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115407.012363:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789115407.012417:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308232064 00000100:00100000:0.0:1789115407.012420:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308232064 00000100:00100000:0.0:1789115407.012444:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308231808 00000100:00100000:0.0:1789115407.012446:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308231808 00000100:00100000:0.0:1789115407.012458:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308231680 00000100:00100000:0.0:1789115407.012460:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308231680 00000100:00100000:0.0:1789115407.012472:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789115407.012477:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8850b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308232064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.012508:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8850b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308232064:12345-0@lo:400:kworker.0 Request processed in 30us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115407.012521:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789115407.012533:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789115407.012537:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8852d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308231808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.012562:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8852d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308231808:12345-0@lo:400:kworker.0 Request processed in 24us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115407.012568:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789115407.012577:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789115407.012583:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8851e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308231680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.012607:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8851e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308231680:12345-0@lo:400:kworker.0 Request processed in 25us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115407.012612:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1789115407.012634:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789115407.012638:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789115407.012640:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789115407.012677:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308231680:0@lo:400:kworker.0 00010000:00080000:0.0:1789115407.012690:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc8853840 x1876023308232192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115407.012699:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8853840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308232192:0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.012707:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308231808:0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.012735:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308231552:0@lo:400:kworker.0 00000100:00100000:0.0:1789115407.012743:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308232064:0@lo:400:kworker.0 00010000:00080000:0.0:1789115407.012753:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcdaad9a40 x1876023308231936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115407.012775:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308231936:0@lo:400:kworker.0 00010000:00010000:2.0:1789115407.078806:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115407.527120:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115407.527140:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308232320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115407.527205:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115407.527662:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308232320 00000100:00100000:1.0:1789115407.527670:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308232320 00000100:00100000:0.0:1789115407.527757:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789115407.527769:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308232320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115407.527812:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115407.527875:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308232320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115407.527884:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1789115407.527921:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff9721c0 x1876023308232320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115407.527939:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308232320:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789115408.099699:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115409.124775:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115409.904425:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115409.904477:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115409.905058:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288275584 00000100:00100000:1.0:1789115409.905072:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288275584 00000100:00100000:0.0:1789115409.905481:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:0.0:1789115409.905497:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2350:x1876023288275584:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115409.905610:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2350:x1876023288275584:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 117us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115409.905620:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:2.0:1789115409.905753:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288275712 00000100:00100000:2.0:1789115409.905760:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288275712 00000100:00100000:2.0:1789115409.906051:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1789115409.906063:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2350:x1876023288275712:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115409.906136:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2350:x1876023288275712:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 75us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115409.906143:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00080000:1.0:1789115409.906625:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789115410.150651:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115411.111526:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff973c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308232448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789115411.111731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115411.115236:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308232448 00000100:00100000:3.0:1789115411.115331:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308232448 00000100:00100000:3.0:1789115411.115531:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789115411.115553:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308232448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789115411.115589:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115411.115795:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308232448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 246us (4064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115411.115803:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789115411.115856:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff973c00 x1876023308232448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115411.115875:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff973c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308232448:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789115411.115921:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789115411.171860:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115412.131662:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff972580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308232576:0@lo:400:kworker.0 00000100:00100000:2.0:1789115412.131737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115412.131975:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308232576 00000100:00100000:0.0:1789115412.131983:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308232576 00000100:00100000:0.0:1789115412.132028:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789115412.132037:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308232576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115412.135872:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff973c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308232960:0@lo:400:kworker.0 00000100:00100000:1.0:1789115412.135942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115412.135985:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789115412.135991:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308233088:0@lo:400:kworker.0 00000100:00100000:1.0:1789115412.136016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115412.138135:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308232576:12345-0@lo:400:kworker.0 Request processed in 6088us (6387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115412.138159:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789115412.138197:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff972580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308232576:0@lo:400:kworker.0 00000100:00100000:0.0:1789115412.138226:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff972940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308232704:0@lo:400:kworker.0 00000100:00100000:2.0:1789115412.138244:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308233088 00000100:00100000:2.0:1789115412.138251:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308233088 00000100:00100000:0.0:1789115412.138277:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115412.138311:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308233216:0@lo:400:kworker.0 00000100:00100000:0.0:1789115412.138336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115412.138358:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789115412.138365:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308232832:0@lo:400:kworker.0 00000100:00100000:0.0:1789115412.139164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115412.139315:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308232704 00000100:00100000:2.0:1789115412.139321:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308232704 00000100:00100000:0.0:1789115412.139335:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308232960 00000100:00100000:0.0:1789115412.139341:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308232960 00000100:00100000:2.0:1789115412.139349:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308232832 00000100:00100000:2.0:1789115412.139353:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308232832 00000100:00100000:0.0:1789115412.139376:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308233216 00000100:00100000:2.0:1789115412.139510:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789115412.139522:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308233088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115412.139595:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308233088:12345-0@lo:400:kworker.0 Request processed in 76us (3577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115412.139602:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789115412.139618:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789115412.139624:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8853840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308232704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115412.139659:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8853840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308232704:12345-0@lo:400:kworker.0 Request processed in 35us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115412.139665:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789115412.139677:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789115412.139683:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8850f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308232832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115412.139711:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8850f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308232832:12345-0@lo:400:kworker.0 Request processed in 29us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115412.139725:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789115412.139767:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308233088:0@lo:400:kworker.0 00000100:00100000:0.0:1789115412.139802:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308233216 00000100:00100000:0.0:1789115412.139843:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789115412.139851:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff972d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308232960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115412.139888:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff972d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308232960:12345-0@lo:400:kworker.0 Request processed in 38us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115412.139894:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789115412.139910:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789115412.139917:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308233216:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789115412.139924:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff973c00 x1876023308232960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115412.139936:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff973c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308232960:0@lo:400:kworker.0 00000100:00100000:0.0:1789115412.139954:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308233216:12345-0@lo:400:kworker.0 Request processed in 37us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115412.139960:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789115412.140023:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308232832:0@lo:400:kworker.0 00000100:00100000:0.0:1789115412.140036:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff972940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308232704:0@lo:400:kworker.0 00010000:00080000:0.0:1789115412.140049:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff973480 x1876023308233216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115412.140067:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308233216:0@lo:400:kworker.0 00000100:00080000:1.0:1789115412.140187:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789115412.140193:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789115412.196100:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115412.643605:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115412.643627:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8851a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308233344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115412.643692:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115412.643796:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308233344 00000100:00100000:0.0:1789115412.643803:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308233344 00000100:00100000:0.0:1789115412.643874:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789115412.643883:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308233344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115412.643915:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115412.643956:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308233344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115412.643963:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789115412.644037:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc8851a40 x1876023308233344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115412.644054:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8851a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308233344:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789115413.221411:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115414.245535:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115415.018711:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115415.018756:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288275840 00000100:00100000:3.0:1789115415.018765:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288275840 00000100:00100000:3.0:1789115415.018820:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:3.0:1789115415.018830:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288275840:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115415.018895:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288275840:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 66us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115415.018902:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:2.0:1789115415.027915:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115415.027974:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288275968 00000100:00100000:0.0:1789115415.027986:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288275968 00000100:00100000:0.0:1789115415.028054:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1789115415.028064:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc084780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288275968:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115415.028153:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc084780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288275968:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 90us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115415.028160:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00080000:1.0:1789115415.029625:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789115415.270143:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115416.228618:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789115416.228641:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308233472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789115416.228712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115416.228775:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308233472 00000100:00100000:0.0:1789115416.228781:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308233472 00000100:00100000:0.0:1789115416.228847:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789115416.228856:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8853c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308233472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789115416.228888:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115416.228930:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8853c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308233472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115416.228948:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789115416.228974:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789115416.229002:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc8852580 x1876023308233472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115416.229020:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308233472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789115416.292881:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115417.256697:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789115417.257646:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8851680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308233728:0@lo:400:kworker.0 00000100:00100000:2.0:1789115417.257717:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115417.257773:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789115417.257779:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308233856:0@lo:400:kworker.0 00000100:00100000:2.0:1789115417.257811:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115417.257849:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308233728 00000100:00100000:2.0:1789115417.257856:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308233728 00000100:00100000:2.0:1789115417.257893:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308233856 00000100:00100000:2.0:1789115417.257896:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308233856 00000100:00100000:2.0:1789115417.257923:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789115417.257931:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc084b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308233728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115417.257982:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc084b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308233728:12345-0@lo:400:kworker.0 Request processed in 52us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115417.257989:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789115417.258004:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789115417.258009:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc086d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308233856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115417.258031:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc086d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308233856:12345-0@lo:400:kworker.0 Request processed in 23us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115417.258051:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789115417.258075:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115417.258104:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308233856:0@lo:400:kworker.0 00000100:00100000:2.0:1789115417.258113:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8851680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308233728:0@lo:400:kworker.0 00000100:00100000:3.0:1789115417.262070:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc88521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308233984:0@lo:400:kworker.0 00000100:00100000:3.0:1789115417.262165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115417.262214:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308233600:0@lo:400:kworker.0 00000100:00100000:3.0:1789115417.262255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115417.262518:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308233984 00000100:00100000:1.0:1789115417.262526:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308233984 00000100:00100000:1.0:1789115417.262578:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789115417.262587:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308233984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115417.262644:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308233984:12345-0@lo:400:kworker.0 Request processed in 58us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115417.262651:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789115417.262696:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc88521c0 x1876023308233984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115417.262708:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc88521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308233984:0@lo:400:kworker.0 00000100:00100000:1.0:1789115417.263550:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308233600 00000100:00100000:1.0:1789115417.263556:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308233600 00000100:00100000:1.0:1789115417.263590:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789115417.263598:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308233600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115417.263652:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308233600:12345-0@lo:400:kworker.0 Request processed in 55us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115417.263658:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789115417.263696:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308233600:0@lo:400:kworker.0 00000100:00100000:3.0:1789115417.265650:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308234112:0@lo:400:kworker.0 00000100:00100000:3.0:1789115417.265713:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115417.265845:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc88521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308234240:0@lo:400:kworker.0 00000100:00100000:2.0:1789115417.265877:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115417.266620:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308234112 00000100:00100000:1.0:1789115417.266629:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308234112 00000100:00100000:1.0:1789115417.266685:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789115417.266694:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308234112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115417.266795:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308234240 00000100:00100000:0.0:1789115417.266800:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308234240 00000100:00100000:0.0:1789115417.266829:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789115417.266836:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc0861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308234240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115417.266877:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc0861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308234240:12345-0@lo:400:kworker.0 Request processed in 41us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115417.266884:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789115417.266923:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc88521c0 x1876023308234240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115417.266935:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc88521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308234240:0@lo:400:kworker.0 00000100:00080000:0.0:1789115417.268412:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789115417.268420:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115417.272623:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308234112:12345-0@lo:400:kworker.0 Request processed in 5920us (6899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115417.272637:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789115417.275816:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308234112:0@lo:400:kworker.0 00010000:00010000:1.0:1789115417.316540:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115417.765844:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789115417.765867:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc88521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308234368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789115417.765940:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115417.766153:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308234368 00000100:00100000:0.0:1789115417.766160:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308234368 00000100:00100000:0.0:1789115417.766224:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789115417.766234:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308234368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115417.766267:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115417.766322:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308234368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115417.766329:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789115417.766738:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc88521c0 x1876023308234368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115417.766758:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc88521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308234368:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789115418.339733:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115419.364555:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115420.144656:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115420.144760:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115420.144935:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288276224 00000100:00100000:2.0:1789115420.144946:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288276224 00000100:00100000:2.0:1789115420.145044:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:2.0:1789115420.145057:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288276224:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115420.145159:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288276224:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 105us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115420.145183:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00080000:3.0:1789115420.145449:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115420.146956:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288276096 00000100:00100000:0.0:1789115420.146972:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288276096 00000100:00100000:0.0:1789115420.147039:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 207 00000100:00100000:0.0:1789115420.147052:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288276096:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115420.147140:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:2353:x1876023288276096:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 91us (2500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115420.147248:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 207 00000001:02000400:1.0:1789115420.203810:0:10120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 04:30:17 (1789115417) === 00010000:00010000:1.0:1789115420.390093:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115420.713064:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115420.713180:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288276352 00000100:00100000:0.0:1789115420.713194:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288276352 00000100:00100000:0.0:1789115420.713487:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 208 00000100:00100000:0.0:1789115420.713501:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+10:8125:x1876023288276352:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789115420.713525:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115420.713551:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28f800/0xa47abda6516d31ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3a29 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115420.713590:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28f800/0xa47abda6516d31ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a29 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115420.713603:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28f800/0xa47abda6516d31ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a29 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115420.713613:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f800, rc 0) 00000100:00100000:0.0:1789115420.713864:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:8125:x1876023288276352:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 366us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115420.713872:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 208 00000100:00100000:3.0:1789115420.717516:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115420.717615:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288276480 00000100:00100000:0.0:1789115420.717628:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288276480 00000100:00100000:0.0:1789115420.717697:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:0.0:1789115420.717728:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:8125:x1876023288276480:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789115420.718103:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:8125:x1876023288276480:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 377us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115420.718113:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:1.0:1789115420.726020:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115420.726116:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288276608 00000100:00100000:0.0:1789115420.726128:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288276608 00000100:00100000:0.0:1789115420.726210:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:0.0:1789115420.726222:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:8125:x1876023288276608:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789115420.726594:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:8125:x1876023288276608:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 372us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115420.726603:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:3.0:1789115420.734676:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115420.734803:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288276736 00000100:00100000:2.0:1789115420.734816:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288276736 00000100:00100000:2.0:1789115420.734886:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:2.0:1789115420.734897:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:8129:x1876023288276736:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789115420.735468:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:8129:x1876023288276736:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 569us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115420.735477:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:2.0:1789115420.771533:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115420.775518:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288276864 00000100:00100000:3.0:1789115420.775539:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288276864 00000100:00100000:3.0:1789115420.775622:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:3.0:1789115420.775633:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:8129:x1876023288276864:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789115420.776173:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:8129:x1876023288276864:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 538us (4654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115420.776183:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:1.0:1789115420.784906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115420.785431:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288276992 00000100:00100000:2.0:1789115420.785444:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288276992 00000100:00100000:2.0:1789115420.785571:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:2.0:1789115420.785584:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:8125:x1876023288276992:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789115420.785630:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115420.785654:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc1520c00/0xa47abda6516d31b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3a53 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115420.785690:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1520c00/0xa47abda6516d31b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a53 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115420.785705:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc1520c00/0xa47abda6516d31b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a53 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115420.785716:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1520c00, rc 0) 00000100:00100000:2.0:1789115420.785820:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:8125:x1876023288276992:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 238us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115420.785830:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:0.0:1789115420.792753:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115420.792939:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288277120 00000100:00100000:3.0:1789115420.792955:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288277120 00000100:00100000:3.0:1789115420.793030:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:3.0:1789115420.793042:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:8125:x1876023288277120:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789115420.793078:0:5846:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789115420.793110:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789115420.793114:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789115420.793118:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789115420.793126:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789115420.800106:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:8125:x1876023288277120:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 7050us (7353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115420.800124:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:3.0:1789115420.803469:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115420.803582:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288277248 00000100:00100000:1.0:1789115420.803596:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288277248 00000100:00100000:1.0:1789115420.803673:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:1.0:1789115420.803685:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:8125:x1876023288277248:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789115420.803709:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115420.803743:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcda95dc00/0xa47abda6516d31bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3a5a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115420.803790:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcda95dc00/0xa47abda6516d31bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a5a expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115420.803804:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcda95dc00/0xa47abda6516d31bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a5a expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115420.803815:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcda95dc00, rc 0) 00000100:00100000:1.0:1789115420.803893:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:8125:x1876023288277248:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 210us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115420.803901:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:3.0:1789115420.807947:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115420.809446:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288277376 00000100:00100000:0.0:1789115420.809465:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288277376 00000100:00100000:1.0:1789115420.811936:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:1.0:1789115420.811956:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:8125:x1876023288277376:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789115420.813949:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:8125:x1876023288277376:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 1979us (5997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115420.813988:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:3.0:1789115420.820637:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115420.820824:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288277504 00000100:00100000:0.0:1789115420.820837:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288277504 00000100:00100000:0.0:1789115420.820975:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:0.0:1789115420.820987:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:8125:x1876023288277504:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789115420.821321:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:8125:x1876023288277504:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 334us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115420.821331:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:3.0:1789115420.829787:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115420.830047:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288277632 00000100:00100000:1.0:1789115420.830060:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288277632 00000100:00100000:1.0:1789115420.830845:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:1.0:1789115420.830861:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:8132:x1876023288277632:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789115420.831657:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:8132:x1876023288277632:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 793us (1892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115420.831670:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:3.0:1789115420.844526:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115420.844744:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288277760 00000100:00100000:0.0:1789115420.844785:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288277760 00000100:00100000:0.0:1789115420.844930:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:0.0:1789115420.844941:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:8132:x1876023288277760:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789115420.845283:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:8132:x1876023288277760:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 343us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115420.845293:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:3.0:1789115420.854608:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115420.854724:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288277888 00000100:00100000:1.0:1789115420.854734:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288277888 00000100:00100000:1.0:1789115420.854802:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1789115420.854820:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1876023288277888:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789115420.854852:0:5852:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 5cadbd13-840d-4129-bfc1-7f8a738ff142@192.168.203.31@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1789115420.854895:0:5852:0:(genops.c:1385:class_connect()) connect: client 5cadbd13-840d-4129-bfc1-7f8a738ff142, cookie 0xa47abda6516d31c3 00000004:00100000:1.0:1789115420.854930:0:5852:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:1.0:1789115420.855236:0:5852:0:(import.c:65:import_set_state_nolock()) ffff8dfcfbfcd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789115420.855489:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:2349:x1876023288277888:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 669us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115420.855498:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1789115420.862500:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115420.862598:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115420.864729:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288278144 00000100:00100000:2.0:1789115420.864742:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288278144 00000100:00100000:0.0:1789115420.864856:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288278016 00000100:00100000:0.0:1789115420.864862:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288278016 00000100:00100000:3.0:1789115420.865477:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:3.0:1789115420.865489:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+7:8125:x1876023288278144:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789115420.865533:0:8213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789115420.865633:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+7:8125:x1876023288278144:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 146us (3143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115420.865640:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:3.0:1789115420.865679:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:3.0:1789115420.865685:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:0:x1876023288278016:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789115420.865697:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789115420.865717:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:0:x1876023288278016:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 32us (3120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115420.865723:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00080000:0.0:1789115420.868510:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115420.870074:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115420.870776:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288278272 00000100:00100000:2.0:1789115420.870787:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288278272 00000100:00100000:2.0:1789115420.870859:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1789115420.870870:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:8125:x1876023288278272:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789115420.872133:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:8125:x1876023288278272:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 1256us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115420.872144:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1789115420.880802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115420.880848:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115420.880883:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115420.880976:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288278400 00000100:00100000:1.0:1789115420.880986:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288278400 00000100:00100000:1.0:1789115420.881020:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288278528 00000100:00100000:1.0:1789115420.881022:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288278528 00000100:00100000:1.0:1789115420.881039:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1789115420.881046:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1876023288278400:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789115420.881085:0:6885:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 5cadbd13-840d-4129-bfc1-7f8a738ff142@192.168.203.31@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1789115420.881120:0:6885:0:(genops.c:1385:class_connect()) connect: client 5cadbd13-840d-4129-bfc1-7f8a738ff142, cookie 0xa47abda6516d31ca 00002000:00100000:1.0:1789115420.881132:0:6885:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5cadbd13-840d-4129-bfc1-7f8a738ff142/ffff8dfcfbfce800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789115420.881156:0:6885:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789115420.881445:0:6885:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789115420.881475:0:6885:0:(import.c:65:import_set_state_nolock()) ffff8dfcfbfcd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789115420.881538:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:2349:x1876023288278400:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 490us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115420.881546:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1789115420.881564:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1789115420.881568:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc085680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1876023288278528:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789115420.881584:0:6885:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 5cadbd13-840d-4129-bfc1-7f8a738ff142@192.168.203.31@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1789115420.881599:0:6885:0:(genops.c:1385:class_connect()) connect: client 5cadbd13-840d-4129-bfc1-7f8a738ff142, cookie 0xa47abda6516d31d1 00002000:00100000:1.0:1789115420.881604:0:6885:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5cadbd13-840d-4129-bfc1-7f8a738ff142/ffff8dfcfbfc9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789115420.881616:0:6885:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789115420.881725:0:6885:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789115420.881739:0:6885:0:(import.c:65:import_set_state_nolock()) ffff8dfcfbfce000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789115420.881771:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc085680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:2349:x1876023288278528:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 191us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115420.881778:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1789115420.884477:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288278656 00000100:00100000:0.0:1789115420.884491:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288278656 00000100:00100000:0.0:1789115420.884591:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:0.0:1789115420.884601:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc087c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:8125:x1876023288278656:12345-192.168.203.31@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789115420.884909:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1789115420.885204:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc087c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:8125:x1876023288278656:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 602us (4317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115420.885213:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:3.0:1789115421.347674:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789115421.347703:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8851680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308234496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789115421.347785:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115421.347865:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308234496 00000100:00100000:3.0:1789115421.347885:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308234496 00000100:00100000:3.0:1789115421.347938:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789115421.347948:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308234496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789115421.347970:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115421.348011:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308234496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115421.348018:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789115421.348041:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789115421.348066:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc8851680 x1876023308234496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115421.348083:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8851680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308234496:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789115421.413492:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789115421.441701:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5cadbd13-840d-4129-bfc1-7f8a738ff142 00000100:00100000:0.0:1789115422.371540:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8850780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308234624:0@lo:400:kworker.0 00000100:00100000:0.0:1789115422.371609:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115422.371656:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc88521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308235136:0@lo:400:kworker.0 00000100:00100000:0.0:1789115422.371682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115422.371705:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789115422.371711:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8851680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308235008:0@lo:400:kworker.0 00000100:00100000:0.0:1789115422.371734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115422.371773:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8852940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308234752:0@lo:400:kworker.0 00000100:00100000:0.0:1789115422.371796:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115422.372138:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308235264:0@lo:400:kworker.0 00000100:00100000:0.0:1789115422.372162:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115422.372188:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789115422.372193:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8851a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308234880:0@lo:400:kworker.0 00000100:00100000:0.0:1789115422.372213:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115422.374449:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308234624 00000100:00100000:0.0:1789115422.374460:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308234624 00000100:00100000:0.0:1789115422.374510:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789115422.374518:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308234624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115422.374589:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308234624:12345-0@lo:400:kworker.0 Request processed in 72us (2981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115422.374596:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789115422.374627:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308235008 00000100:00100000:0.0:1789115422.374630:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308235008 00000100:00100000:0.0:1789115422.374651:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308235264 00000100:00100000:0.0:1789115422.374653:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308235264 00000100:00100000:0.0:1789115422.374678:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789115422.374684:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308235008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115422.374713:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308235008:12345-0@lo:400:kworker.0 Request processed in 29us (2978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115422.374719:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789115422.374730:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789115422.374735:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308235264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115422.376327:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308235136 00000100:00100000:3.0:1789115422.376340:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308235136 00000100:00100000:3.0:1789115422.376395:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308234752 00000100:00100000:3.0:1789115422.376399:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308234752 00000100:00100000:3.0:1789115422.376412:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308234880 00000100:00100000:3.0:1789115422.376414:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308234880 00000100:00100000:3.0:1789115422.376430:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789115422.376438:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308235136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115422.376506:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308235136:12345-0@lo:400:kworker.0 Request processed in 69us (4823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115422.376513:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789115422.376527:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789115422.376532:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308234752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115422.376565:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308234752:12345-0@lo:400:kworker.0 Request processed in 32us (4768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115422.376582:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789115422.376592:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789115422.376598:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308234880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115422.376624:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308234880:12345-0@lo:400:kworker.0 Request processed in 27us (4410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115422.376630:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789115422.378585:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308235264:12345-0@lo:400:kworker.0 Request processed in 3841us (6413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115422.378598:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789115422.378671:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc8851680 x1876023308235008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115422.378697:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8851680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308235008:0@lo:400:kworker.0 00000100:00100000:0.0:1789115422.378711:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8850780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308234624:0@lo:400:kworker.0 00000100:00100000:0.0:1789115422.378723:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc88521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308235136:0@lo:400:kworker.0 00000100:00080000:0.0:1789115422.378767:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789115422.378773:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789115422.378790:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8851a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308234880:0@lo:400:kworker.0 00000100:00100000:0.0:1789115422.378810:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8852940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308234752:0@lo:400:kworker.0 00010000:00080000:0.0:1789115422.378822:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc8852580 x1876023308235264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115422.378831:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308235264:0@lo:400:kworker.0 00010000:00010000:2.0:1789115422.438684:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115422.885082:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308235392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115422.885148:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115422.885263:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308235392 00000100:00100000:1.0:1789115422.885271:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308235392 00000100:00100000:1.0:1789115422.885321:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789115422.885330:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308235392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789115422.885375:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115422.885438:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308235392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115422.885446:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789115422.885543:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50f30c0 x1876023308235392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115422.885564:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308235392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789115423.465028:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789115424.469503:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5cadbd13-840d-4129-bfc1-7f8a738ff142 00000001:00100000:0.0:1789115424.471242:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5cadbd13-840d-4129-bfc1-7f8a738ff142 00010000:00010000:3.0:1789115424.483679:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115425.507843:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115426.279319:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115426.279361:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115426.279432:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115426.279450:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115426.279478:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115426.279504:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288278912 00000100:00100000:3.0:1789115426.279514:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288278912 00000100:00100000:3.0:1789115426.279566:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288279040 00000100:00100000:3.0:1789115426.279569:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288279040 00000100:00100000:3.0:1789115426.279591:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:3.0:1789115426.279600:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff911a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2350:x1876023288278912:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115426.279670:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff911a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2350:x1876023288278912:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 71us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115426.279694:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:3.0:1789115426.279712:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:3.0:1789115426.279718:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff910780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2350:x1876023288279040:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115426.279755:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff910780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2350:x1876023288279040:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 37us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115426.279760:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:1.0:1789115426.279955:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288278784 00000100:00100000:1.0:1789115426.279959:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288278784 00000100:00100000:1.0:1789115426.279988:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:1.0:1789115426.279996:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288278784:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115426.280028:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288278784:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 33us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115426.280034:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:2.0:1789115426.280139:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288279168 00000100:00100000:2.0:1789115426.280144:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288279168 00000100:00100000:2.0:1789115426.280182:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288279296 00000100:00100000:2.0:1789115426.280185:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288279296 00000100:00100000:2.0:1789115426.280206:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:2.0:1789115426.280213:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff912940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2350:x1876023288279168:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115426.280246:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff912940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2350:x1876023288279168:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 34us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115426.280252:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:2.0:1789115426.280264:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:2.0:1789115426.280270:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff912580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2350:x1876023288279296:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115426.280289:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff912580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2350:x1876023288279296:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 20us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115426.280293:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00080000:0.0:1789115426.280473:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789115426.280477:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789115426.280479:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115426.467862:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308235520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789115426.467933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115426.468041:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308235520 00000100:00100000:3.0:1789115426.468049:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308235520 00000100:00100000:3.0:1789115426.468116:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789115426.468125:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308235520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789115426.468155:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115426.468199:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308235520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115426.468214:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789115426.468283:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc8850000 x1876023308235520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115426.468300:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308235520:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789115426.468354:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789115426.535321:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789115426.783140:0:10315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1789115427.492164:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8850780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308235904:0@lo:400:kworker.0 00000100:00100000:0.0:1789115427.492249:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115427.492306:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789115427.492313:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc88521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308235776:0@lo:400:kworker.0 00000100:00100000:0.0:1789115427.492336:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115427.492353:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308236288:0@lo:400:kworker.0 00000100:00100000:0.0:1789115427.492378:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115427.492439:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308235904 00000100:00100000:0.0:1789115427.492452:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308235904 00000100:00100000:0.0:1789115427.492500:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308235776 00000100:00100000:0.0:1789115427.492503:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308235776 00000100:00100000:0.0:1789115427.492525:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789115427.492533:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308235904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115427.492584:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308235904:12345-0@lo:400:kworker.0 Request processed in 51us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115427.492592:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789115427.492610:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789115427.492616:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308235776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115427.492644:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308235776:12345-0@lo:400:kworker.0 Request processed in 28us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115427.492649:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1789115427.492665:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115427.492696:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc88521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308235776:0@lo:400:kworker.0 00000100:00100000:0.0:1789115427.492708:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8850780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308235904:0@lo:400:kworker.0 00000100:00100000:1.0:1789115427.492932:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8851a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308235648:0@lo:400:kworker.0 00000100:00100000:1.0:1789115427.492965:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115427.493000:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308236160:0@lo:400:kworker.0 00000100:00100000:1.0:1789115427.493023:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115427.493054:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789115427.493060:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8851680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308236032:0@lo:400:kworker.0 00000100:00100000:1.0:1789115427.493085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115427.493119:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308236288 00000100:00100000:1.0:1789115427.493123:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308236288 00000100:00100000:1.0:1789115427.493155:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308236032 00000100:00100000:1.0:1789115427.493158:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308236032 00000100:00100000:1.0:1789115427.493174:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789115427.493180:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308236288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115427.493217:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308236288:12345-0@lo:400:kworker.0 Request processed in 37us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115427.493223:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789115427.493236:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789115427.493241:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedb3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308236032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115427.493284:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedb3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308236032:12345-0@lo:400:kworker.0 Request processed in 29us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115427.493291:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1789115427.493462:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789115427.493481:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc8851680 x1876023308236032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115427.493493:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8851680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308236032:0@lo:400:kworker.0 00000100:00100000:1.0:1789115427.493510:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308236160 00000100:00100000:1.0:1789115427.493514:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308236160 00000100:00100000:1.0:1789115427.493542:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789115427.493549:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308236160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115427.493581:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308236160:12345-0@lo:400:kworker.0 Request processed in 33us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115427.493597:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1789115427.493615:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115427.493632:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308236160:0@lo:400:kworker.0 00010000:00080000:1.0:1789115427.493655:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc8850000 x1876023308236288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115427.493665:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308236288:0@lo:400:kworker.0 00000100:00100000:0.0:1789115427.493823:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308235648 00000100:00100000:0.0:1789115427.493828:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308235648 00000100:00100000:0.0:1789115427.493851:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789115427.493857:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308235648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115427.493894:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308235648:12345-0@lo:400:kworker.0 Request processed in 37us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115427.493899:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789115427.494085:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8851a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308235648:0@lo:400:kworker.0 00010000:00010000:3.0:1789115427.555759:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115428.005992:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115428.006014:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff913c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308236416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115428.006077:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115428.006144:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308236416 00000100:00100000:3.0:1789115428.006152:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308236416 00000100:00100000:3.0:1789115428.006196:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789115428.006205:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff911680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308236416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789115428.006239:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115428.006280:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff911680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308236416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115428.006303:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789115428.006345:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff913c00 x1876023308236416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115428.006362:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff913c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308236416:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789115428.579614:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115429.605730:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115430.628940:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115431.405698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115431.405751:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115431.405790:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115431.405901:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288279808 00000100:00100000:1.0:1789115431.405913:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288279808 00000100:00100000:1.0:1789115431.405997:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:1.0:1789115431.406008:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2352:x1876023288279808:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115431.406103:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2352:x1876023288279808:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 97us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115431.406111:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:3.0:1789115431.406423:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115431.406450:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115431.406474:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288279552 00000100:00100000:3.0:1789115431.406479:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288279552 00000100:00100000:3.0:1789115431.406524:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288279680 00000100:00100000:3.0:1789115431.406527:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288279680 00000100:00100000:3.0:1789115431.406547:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:3.0:1789115431.406555:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff913c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288279552:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115431.406597:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff913c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288279552:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115431.406604:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:3.0:1789115431.406619:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:3.0:1789115431.406626:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2352:x1876023288279680:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115431.406889:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288279424 00000100:00100000:1.0:1789115431.406895:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288279424 00000100:00100000:1.0:1789115431.406927:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:1.0:1789115431.406934:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2352:x1876023288279424:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115431.406962:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2352:x1876023288279424:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115431.406969:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00080000:2.0:1789115431.407012:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789115431.407025:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789115431.407076:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288279936 00000100:00100000:2.0:1789115431.407087:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288279936 00000100:00100000:2.0:1789115431.407170:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:2.0:1789115431.407181:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2352:x1876023288279936:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115431.407273:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2352:x1876023288279936:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 93us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115431.407282:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:3.0:1789115431.407312:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2352:x1876023288279680:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 683us (886us total) trans 0 rc 0/0 00000100:00080000:2.0:1789115431.407313:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789115431.407328:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:0.0:1789115431.588728:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789115431.588749:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308236544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789115431.588828:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115431.588914:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308236544 00000100:00100000:0.0:1789115431.588921:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308236544 00000100:00100000:0.0:1789115431.588991:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789115431.589000:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308236544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789115431.589035:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115431.589081:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308236544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115431.589089:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789115431.589114:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789115431.589142:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff9d6d00 x1876023308236544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115431.589165:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308236544:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789115431.652882:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115432.612659:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308236800:0@lo:400:kworker.0 00000100:00100000:2.0:1789115432.612742:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115432.612818:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff912580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308237312:0@lo:400:kworker.0 00000100:00100000:2.0:1789115432.612845:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115432.612873:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789115432.612880:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff910b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308236928:0@lo:400:kworker.0 00000100:00100000:2.0:1789115432.612905:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115432.612940:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308236800 00000100:00100000:2.0:1789115432.612947:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308236800 00000100:00100000:2.0:1789115432.612991:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308236928 00000100:00100000:2.0:1789115432.612994:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308236928 00000100:00100000:2.0:1789115432.613022:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789115432.613030:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff973c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308236800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115432.613081:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff973c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308236800:12345-0@lo:400:kworker.0 Request processed in 52us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115432.613101:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789115432.613119:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789115432.613126:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff972580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308236928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115432.613154:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff972580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308236928:12345-0@lo:400:kworker.0 Request processed in 29us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115432.613160:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789115432.613209:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff910b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308236928:0@lo:400:kworker.0 00000100:00100000:2.0:1789115432.613220:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308236800:0@lo:400:kworker.0 00000100:00100000:0.0:1789115432.613379:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff913840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308236672:0@lo:400:kworker.0 00000100:00100000:0.0:1789115432.613438:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115432.613460:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff912940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308237184:0@lo:400:kworker.0 00000100:00100000:0.0:1789115432.613483:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115432.613500:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789115432.613506:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff912d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308237056:0@lo:400:kworker.0 00000100:00100000:0.0:1789115432.613527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789115432.613546:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115432.613557:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308237184 00000100:00100000:0.0:1789115432.613560:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308237184 00000100:00100000:0.0:1789115432.613590:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789115432.613596:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308237184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115432.613631:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308237184:12345-0@lo:400:kworker.0 Request processed in 35us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115432.613652:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789115432.613668:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115432.613699:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff912940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308237184:0@lo:400:kworker.0 00000100:00100000:1.0:1789115432.613927:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308237312 00000100:00100000:1.0:1789115432.613932:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308237312 00000100:00100000:1.0:1789115432.613979:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308237056 00000100:00100000:1.0:1789115432.613983:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308237056 00000100:00100000:1.0:1789115432.614002:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789115432.614010:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308237312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115432.614054:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308237312:12345-0@lo:400:kworker.0 Request processed in 46us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115432.614061:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789115432.614073:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789115432.614079:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308237056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115432.614124:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308237056:12345-0@lo:400:kworker.0 Request processed in 46us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115432.614130:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1789115432.614174:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff912d00 x1876023308237056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115432.614186:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff912d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308237056:0@lo:400:kworker.0 00010000:00080000:1.0:1789115432.614214:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff912580 x1876023308237312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115432.614225:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff912580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308237312:0@lo:400:kworker.0 00000100:00100000:2.0:1789115432.614569:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308236672 00000100:00100000:2.0:1789115432.614574:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308236672 00000100:00100000:2.0:1789115432.614613:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789115432.614629:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308236672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115432.614672:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308236672:12345-0@lo:400:kworker.0 Request processed in 46us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115432.614678:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789115432.614735:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff913840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308236672:0@lo:400:kworker.0 00000100:00080000:0.0:1789115432.614808:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789115432.676668:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115433.123652:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789115433.123685:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308237440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789115433.123767:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115433.124101:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308237440 00000100:00100000:3.0:1789115433.124122:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308237440 00000100:00100000:3.0:1789115433.124177:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789115433.124187:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308237440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789115433.124222:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115433.124276:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308237440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115433.124283:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789115433.127560:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff910f00 x1876023308237440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115433.127591:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308237440:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789115433.701470:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115434.724680:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115435.748135:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115436.523265:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115436.523319:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115436.523356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115436.523375:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115436.523419:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115436.523466:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288280192 00000100:00100000:2.0:1789115436.523476:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288280192 00000100:00100000:3.0:1789115436.523597:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288280320 00000100:00100000:3.0:1789115436.523603:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288280320 00000100:00100000:3.0:1789115436.523676:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:3.0:1789115436.523689:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff970f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288280320:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115436.523744:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288280448 00000100:00100000:1.0:1789115436.523751:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288280448 00000100:00100000:3.0:1789115436.523769:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff970f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288280320:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 82us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115436.523777:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:1.0:1789115436.523786:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288280576 00000100:00100000:1.0:1789115436.523791:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288280576 00000100:00080000:3.0:1789115436.523804:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789115436.523810:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789115436.523813:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115436.523824:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:1.0:1789115436.523833:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff972940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288280448:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115436.523866:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff972940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288280448:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 34us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115436.523872:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:1.0:1789115436.523885:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:1.0:1789115436.523891:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288280576:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115436.523914:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288280576:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 24us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115436.523921:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:1.0:1789115436.523937:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288280064 00000100:00100000:1.0:1789115436.523941:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288280064 00000100:00100000:1.0:1789115436.523971:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:1.0:1789115436.523978:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2351:x1876023288280064:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115436.524003:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2351:x1876023288280064:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115436.524010:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:2.0:1789115436.524635:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:2.0:1789115436.524644:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff970780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2351:x1876023288280192:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115436.524792:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff970780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2351:x1876023288280192:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 148us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115436.524799:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00080000:3.0:1789115436.525512:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115436.708003:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789115436.708024:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff972d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308237568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789115436.708094:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115436.708162:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308237568 00000100:00100000:2.0:1789115436.708169:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308237568 00000100:00100000:2.0:1789115436.708221:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789115436.708230:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308237568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789115436.708263:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115436.708308:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308237568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115436.708324:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789115436.708345:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789115436.708373:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff972d00 x1876023308237568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115436.708629:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff972d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308237568:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789115436.777300:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115437.736363:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff913840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308238080:0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.736454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115437.736510:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789115437.736516:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308237696:0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.736543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115437.736564:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff912580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308238208:0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.736601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115437.736625:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308237824:0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.736662:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115437.736679:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff912d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308238336:0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.736699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115437.736717:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115437.736722:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308237952:0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.736744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115437.736782:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308238080 00000100:00100000:3.0:1789115437.736788:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308238080 00000100:00100000:3.0:1789115437.736829:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308238336 00000100:00100000:3.0:1789115437.736833:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308238336 00000100:00100000:3.0:1789115437.736866:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789115437.736874:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff912940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308238080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.736924:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff912940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308238080:12345-0@lo:400:kworker.0 Request processed in 50us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115437.736931:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789115437.736948:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789115437.736954:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc0852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308238336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.736985:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc0852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308238336:12345-0@lo:400:kworker.0 Request processed in 31us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115437.736990:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789115437.737008:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308237696 00000100:00100000:3.0:1789115437.737012:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308237696 00000100:00100000:3.0:1789115437.737032:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789115437.737037:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308237696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.737073:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308237696:12345-0@lo:400:kworker.0 Request processed in 35us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115437.737079:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789115437.737101:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308238208 00000100:00100000:3.0:1789115437.737103:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308238208 00000100:00100000:3.0:1789115437.737123:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308237824 00000100:00100000:3.0:1789115437.737125:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308237824 00000100:00100000:3.0:1789115437.737133:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308237952 00000100:00100000:3.0:1789115437.737135:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308237952 00000100:00100000:3.0:1789115437.737146:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789115437.737152:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308238208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.737178:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308238208:12345-0@lo:400:kworker.0 Request processed in 27us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115437.737184:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789115437.737196:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789115437.737202:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff910b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308237824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.737227:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff910b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308237824:12345-0@lo:400:kworker.0 Request processed in 26us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115437.737233:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789115437.737242:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789115437.737248:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc085a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308237952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.737273:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc085a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308237952:12345-0@lo:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115437.737278:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789115437.737304:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789115437.737308:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789115437.737340:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308237952:0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.737358:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308237824:0@lo:400:kworker.0 00010000:00080000:3.0:1789115437.737370:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff912d00 x1876023308238336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115437.737403:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff912d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308238336:0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.737436:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308237696:0@lo:400:kworker.0 00000100:00100000:3.0:1789115437.737445:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff912580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308238208:0@lo:400:kworker.0 00010000:00080000:3.0:1789115437.737454:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff913840 x1876023308238080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115437.737463:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff913840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308238080:0@lo:400:kworker.0 00010000:00010000:1.0:1789115437.798999:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115438.244938:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc0861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308238464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789115438.245019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115438.245566:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308238464 00000100:00100000:3.0:1789115438.245575:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308238464 00000100:00100000:3.0:1789115438.245622:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789115438.245631:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff972d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308238464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789115438.245805:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115438.246781:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff972d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308238464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1146us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115438.246793:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789115438.251294:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc0861c0 x1876023308238464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115438.251334:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc0861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308238464:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789115438.820783:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115439.852473:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115440.868965:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115441.640248:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115441.640298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115441.640323:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115441.640348:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115441.640430:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115441.640439:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288280704 00000100:00100000:3.0:1789115441.640448:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288280704 00000100:00100000:1.0:1789115441.640457:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288281088 00000100:00100000:1.0:1789115441.640462:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288281088 00000100:00100000:3.0:1789115441.640502:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:3.0:1789115441.640515:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288280704:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115441.640516:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288281216 00000100:00100000:1.0:1789115441.640521:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288281216 00000100:00100000:1.0:1789115441.640546:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1789115441.640555:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2349:x1876023288281088:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:1.0:1789115441.640578:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d31ca 00000100:00080000:1.0:1789115441.640587:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8dfcfbfcd000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789115441.640600:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288280704:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115441.640609:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 227 00000001:00000004:1.0:1789115441.640616:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789115441.640921:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288280832 00000100:00100000:0.0:1789115441.640926:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288280832 00000100:00100000:0.0:1789115441.640969:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288280960 00000100:00100000:0.0:1789115441.640972:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288280960 00000100:00100000:0.0:1789115441.640995:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:0.0:1789115441.641002:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2350:x1876023288280832:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115441.641037:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2350:x1876023288280832:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 35us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115441.641043:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:0.0:1789115441.641060:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:0.0:1789115441.641066:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2350:x1876023288280960:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115441.641110:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2350:x1876023288280960:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 32us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115441.641117:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:0.0:1789115441.641139:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1789115441.641146:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd217e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2349:x1876023288281216:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:0.0:1789115441.641160:0:6885:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d31d1 00000100:00080000:0.0:1789115441.641166:0:6885:0:(import.c:65:import_set_state_nolock()) ffff8dfcfbfce000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789115441.641192:0:6885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789115441.641516:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd217e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+2:2349:x1876023288281216:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 369us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115441.641535:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00010000:00010000:0.0:1789115441.641567:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115441.642101:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cadbd13-840d-4129-bfc1-7f8a738ff142+2:2349:x1876023288281088:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 1546us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115441.642110:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00080000:1.0:1789115441.642133:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789115441.642137:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789115441.642139:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789115441.642149:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115441.827595:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789115441.832603:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308238592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789115441.832680:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115441.832927:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308238592 00000100:00100000:2.0:1789115441.832934:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308238592 00000100:00100000:2.0:1789115441.832998:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789115441.833006:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308238592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789115441.833039:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115441.833078:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308238592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115441.833084:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1789115441.833120:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcedabf480 x1876023308238592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115441.833138:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308238592:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789115441.833184:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789115441.891982:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789115441.905061:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5cadbd13-840d-4129-bfc1-7f8a738ff142 00000020:00000080:3.0:1789115441.905077:0:6724:0:(genops.c:885:class_export_put()) final put ffff8dfcfbfce800/5cadbd13-840d-4129-bfc1-7f8a738ff142 00000020:00000080:0.0:1789115441.905255:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcfbfce800/5cadbd13-840d-4129-bfc1-7f8a738ff142 for lustre-OST0000 00000020:00000080:0.0:1789115441.905440:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcfbfcd000 for lustre-OST0000 00000100:00100000:1.0:1789115442.852879:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308238720:0@lo:400:kworker.0 00000100:00100000:1.0:1789115442.852947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115442.852992:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308239232:0@lo:400:kworker.0 00000100:00100000:1.0:1789115442.853028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115442.853053:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789115442.853058:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308239104:0@lo:400:kworker.0 00000100:00100000:1.0:1789115442.853080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115442.853104:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308238848:0@lo:400:kworker.0 00000100:00100000:1.0:1789115442.853127:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115442.853143:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308239360:0@lo:400:kworker.0 00000100:00100000:1.0:1789115442.853164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115442.853180:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789115442.853184:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308238976:0@lo:400:kworker.0 00000100:00100000:1.0:1789115442.853202:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115442.853232:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308238720 00000100:00100000:1.0:1789115442.853239:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308238720 00000100:00100000:1.0:1789115442.853279:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789115442.853287:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308238720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115442.853333:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308238720:12345-0@lo:400:kworker.0 Request processed in 46us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115442.853339:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789115442.853373:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308239232 00000100:00100000:1.0:1789115442.853377:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308239232 00000100:00100000:1.0:1789115442.853428:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308238848 00000100:00100000:1.0:1789115442.853431:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308238848 00000100:00100000:0.0:1789115442.853433:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308238976 00000100:00100000:0.0:1789115442.853436:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308238976 00000100:00100000:1.0:1789115442.853446:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789115442.853451:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308239232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115442.853455:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789115442.853460:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308238848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115442.853489:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308239232:12345-0@lo:400:kworker.0 Request processed in 37us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115442.853492:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308238848:12345-0@lo:400:kworker.0 Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115442.853495:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789115442.853498:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789115442.853508:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789115442.853513:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8827c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308238976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115442.853541:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8827c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308238976:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115442.854840:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308238976:0@lo:400:kworker.0 00000100:00100000:0.0:1789115442.854854:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308238848:0@lo:400:kworker.0 00000100:00100000:0.0:1789115442.855513:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308239104 00000100:00100000:0.0:1789115442.855521:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308239104 00000100:00100000:0.0:1789115442.855562:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308239360 00000100:00100000:0.0:1789115442.855564:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308239360 00000100:00100000:0.0:1789115442.855588:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789115442.855595:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308239104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115442.855768:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308239104:12345-0@lo:400:kworker.0 Request processed in 173us (2686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115442.855775:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789115442.855789:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789115442.855794:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8825a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308239360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115442.855835:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8825a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308239360:12345-0@lo:400:kworker.0 Request processed in 42us (2670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115442.855841:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1789115442.855877:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcedabc3c0 x1876023308239360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115442.855890:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308239360:0@lo:400:kworker.0 00010000:00080000:2.0:1789115442.856470:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcedabed00 x1876023308239104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115442.856481:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308239104:0@lo:400:kworker.0 00000100:00100000:2.0:1789115442.856490:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308238720:0@lo:400:kworker.0 00000100:00100000:2.0:1789115442.856501:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308239232:0@lo:400:kworker.0 00000100:00080000:0.0:1789115442.857597:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789115442.857606:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115442.858537:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00010000:0.0:1789115442.917358:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115443.363725:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789115443.363747:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc085680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308239488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789115443.363812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115443.363948:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308239488 00000100:00100000:2.0:1789115443.363955:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308239488 00000100:00100000:2.0:1789115443.364005:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789115443.364014:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308239488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789115443.364045:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115443.364089:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308239488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115443.364096:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789115443.364163:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc085680 x1876023308239488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115443.364180:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc085680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308239488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789115443.939704:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789115444.117256:0:11014:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789115444.963692:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789115444.966625:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5cadbd13-840d-4129-bfc1-7f8a738ff142 00000020:00000080:0.0:1789115444.966634:0:7644:0:(genops.c:885:class_export_put()) final put ffff8dfcfbfc9800/5cadbd13-840d-4129-bfc1-7f8a738ff142 00000020:00000080:2.0:1789115444.967930:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcfbfc9800/5cadbd13-840d-4129-bfc1-7f8a738ff142 for lustre-OST0001 00000020:00000080:2.0:1789115444.968001:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcfbfce000 for lustre-OST0001 00010000:00010000:0.0:1789115445.987712:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115446.757743:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115446.757786:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115446.757873:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288281344 00000100:00100000:3.0:1789115446.757883:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288281344 00000100:00100000:3.0:1789115446.757945:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:3.0:1789115446.757954:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288281344:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115446.758021:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288281344:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 68us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115446.758029:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:1.0:1789115446.758288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115446.759152:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288281600 00000100:00100000:0.0:1789115446.759161:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288281600 00000100:00100000:0.0:1789115446.759257:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288281472 00000100:00100000:0.0:1789115446.759260:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288281472 00000100:00100000:2.0:1789115446.759295:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:2.0:1789115446.759307:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8825680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2350:x1876023288281600:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115446.759364:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8825680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2350:x1876023288281600:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 61us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115446.759372:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00080000:1.0:1789115446.760397:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115446.760629:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:0.0:1789115446.760639:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8825e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2350:x1876023288281472:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115446.760698:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8825e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2350:x1876023288281472:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 62us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115446.760722:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:3.0:1789115446.949574:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308239616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789115446.949665:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115446.949837:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308239616 00000100:00100000:0.0:1789115446.949845:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308239616 00000100:00100000:0.0:1789115446.949912:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789115446.949921:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc086940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308239616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789115446.949953:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115446.949999:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc086940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308239616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115446.950006:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789115446.950043:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff9d5680 x1876023308239616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115446.950061:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308239616:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789115446.950165:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789115447.014526:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115447.972126:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308240000:0@lo:400:kworker.0 00000100:00100000:0.0:1789115447.972203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115447.972260:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789115447.972267:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308239872:0@lo:400:kworker.0 00000100:00100000:0.0:1789115447.972291:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115447.972309:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308240384:0@lo:400:kworker.0 00000100:00100000:0.0:1789115447.972333:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115447.972368:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308240000 00000100:00100000:0.0:1789115447.972375:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308240000 00000100:00100000:0.0:1789115447.972446:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308239872 00000100:00100000:0.0:1789115447.972450:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308239872 00000100:00100000:0.0:1789115447.972472:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789115447.972480:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308240000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115447.972545:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308240000:12345-0@lo:400:kworker.0 Request processed in 65us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115447.972554:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789115447.972572:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789115447.972593:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308239872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115447.972915:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308240128:0@lo:400:kworker.0 00000100:00100000:3.0:1789115447.972946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115447.972966:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789115447.972972:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308239744:0@lo:400:kworker.0 00000100:00100000:3.0:1789115447.972997:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115447.973016:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308240256:0@lo:400:kworker.0 00000100:00100000:3.0:1789115447.973034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115447.973469:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308239872:12345-0@lo:400:kworker.0 Request processed in 890us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115447.973477:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789115447.973492:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308240256 00000100:00100000:0.0:1789115447.973496:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308240256 00000100:00100000:0.0:1789115447.973518:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789115447.973525:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308240256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115447.973563:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308240256:12345-0@lo:400:kworker.0 Request processed in 38us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115447.973569:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789115447.973745:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308239744 00000100:00100000:2.0:1789115447.973750:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308239744 00000100:00100000:2.0:1789115447.973782:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789115447.973789:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308239744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115447.973823:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308239744:12345-0@lo:400:kworker.0 Request processed in 36us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115447.973829:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789115447.974739:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308240384 00000100:00100000:0.0:1789115447.974748:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308240384 00000100:00100000:0.0:1789115447.974783:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308240128 00000100:00100000:0.0:1789115447.974786:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308240128 00000100:00100000:0.0:1789115447.974807:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789115447.974814:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308240384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115447.974865:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308240384:12345-0@lo:400:kworker.0 Request processed in 51us (2531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115447.974872:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789115447.974884:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789115447.974890:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc085680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308240128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115447.974934:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc085680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308240128:12345-0@lo:400:kworker.0 Request processed in 44us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115447.974941:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789115447.974964:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789115447.974968:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115447.975014:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308239744:0@lo:400:kworker.0 00000100:00100000:0.0:1789115447.975029:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308240256:0@lo:400:kworker.0 00010000:00080000:0.0:1789115447.975041:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff9d4780 x1876023308240128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115447.975051:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308240128:0@lo:400:kworker.0 00000100:00100000:0.0:1789115447.975087:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308239872:0@lo:400:kworker.0 00010000:00080000:0.0:1789115447.975098:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff9d5a40 x1876023308240384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115447.975108:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308240384:0@lo:400:kworker.0 00000100:00100000:0.0:1789115447.975119:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308240000:0@lo:400:kworker.0 00010000:00010000:3.0:1789115448.035691:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115448.485359:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115448.485423:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc0861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308240512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115448.485496:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115448.485569:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308240512 00000100:00100000:2.0:1789115448.485654:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308240512 00000100:00100000:2.0:1789115448.485708:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789115448.485726:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff913840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308240512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789115448.485765:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115448.485813:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff913840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308240512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115448.485820:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789115448.486123:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc0861c0 x1876023308240512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115448.486142:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc0861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308240512:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1789115448.843078:0:11164:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccd419950 20000000:00000080:3.0:1789115448.843094:0:11164:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dfcfbf1d400 uarg=0000000000000000 20000000:01000000:3.0:1789115448.843130:0:11164:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789115448.843136:0:11164:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789115448.843141:0:11164:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789115448.844007:0:11165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789115448.844143:0:11164:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789115448.848836:0:11164:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789115448.849148:0:11164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115448.849169:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d317d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a22 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115448.849178:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d318b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3184 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115448.849185:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3192 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115448.849190:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d31a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d31a0 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115448.849215:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcda95dc00/0xa47abda6516d31bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a5a expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115448.849222:0:11164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115448.849264:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcda95dc00/0xa47abda6516d31bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a5a expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115448.849278:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfcda95dc00/0xa47abda6516d31bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a5a expref: 12 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115448.849291:0:11164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc88243c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876023308240640:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115448.849511:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d31a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d31a0 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115448.849519:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d31a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d31a0 expref: 18 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115448.849528:0:11164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876023308240768:0@lo:104: 00000100:00100000:1.0:1789115448.849568:0:11164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789115448.849651:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d3192 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115448.849660:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3199 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d3192 expref: 18 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115448.849668:0:11164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876023308240896:0@lo:104: 00000100:00100000:1.0:1789115448.849710:0:11164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789115448.850692:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d318b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d3184 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115448.850706:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d318b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d3184 expref: 18 pid: 5843 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115448.850717:0:11164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3421a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876023308241024:0@lo:104: 00000100:00100000:1.0:1789115448.850753:0:11164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115448.850807:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308240768 00000100:00100000:3.0:1789115448.850814:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308240768 00010000:00010000:1.0:1789115448.850929:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d317d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a22 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115448.850939:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d317d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a22 expref: 12 pid: 5844 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115448.850948:0:11164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876023308241152:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115448.850997:0:11164:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd0dca000 going to sleep for 11 seconds 00000100:00100000:3.0:1789115448.851626:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308240896 00000100:00100000:3.0:1789115448.851632:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308240896 00000100:00100000:3.0:1789115448.851646:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308241024 00000100:00100000:3.0:1789115448.851648:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308241024 00000100:00100000:3.0:1789115448.851662:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789115448.851670:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8826d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+5:11164:x1876023308240768:12345-0@lo:104: 00010000:00010000:3.0:1789115448.851685:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d31a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.851756:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789115448.851762:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8826d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+5:11164:x1876023308240768:12345-0@lo:104: Request processed in 93us (2195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115448.851769:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789115448.851787:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789115448.851793:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc332580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+4:11164:x1876023308240896:12345-0@lo:104: 00010000:00010000:3.0:1789115448.851810:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3199 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.851847:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789115448.851853:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc332580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+4:11164:x1876023308240896:12345-0@lo:104: Request processed in 61us (2143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115448.851858:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789115448.851871:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789115448.851876:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd3423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+3:11164:x1876023308241024:12345-0@lo:104: 00010000:00010000:3.0:1789115448.851883:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d318b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.851914:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789115448.851919:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd3423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+3:11164:x1876023308241024:12345-0@lo:104: Request processed in 44us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115448.851925:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789115448.851941:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789115448.851947:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d31a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.851954:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c5400 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115448.851958:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d31a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.851966:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d31a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115448.851974:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d31a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115448.851985:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789115448.852012:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d31a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852018:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115448.852037:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d31a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852044:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5400/0xa47abda6516d31a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d31a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852064:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789115448.852067:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3199 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852072:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c5e00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115448.852074:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d3199 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852080:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d3199 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115448.852085:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d3199 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115448.852090:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789115448.852101:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3199 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852107:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115448.852120:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3199 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852126:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5e00/0xa47abda6516d3192 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3199 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852136:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115448.852139:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d318b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852144:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1520400 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115448.852147:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d318b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852153:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d318b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115448.852159:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d318b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115448.852165:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789115448.852177:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d318b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852182:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115448.852197:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d318b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852204:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d3184 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d318b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852217:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115448.852224:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115448.852225:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115448.852232:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115448.852245:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308241536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789115448.852278:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115448.852316:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308241536 00000100:00100000:3.0:1789115448.852321:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308241536 00010000:00010000:3.0:1789115448.852338:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d318b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d3184 expref: 19 pid: 5843 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115448.852360:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789115448.852367:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3307:x1876023308241536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789115448.852377:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115448.852408:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d318b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d3184 expref: 19 pid: 5843 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852419:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d318b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d3184 expref: 19 pid: 5843 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115448.852434:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115448.852462:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3307:x1876023308241536:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115448.852468:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789115448.852524:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308241536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789115448.852602:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115448.852613:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308241280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789115448.852640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115448.852670:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789115448.852675:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff912d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308241408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789115448.852693:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115448.852725:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308241280 00000100:00100000:0.0:1789115448.852729:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308241280 00010000:00010000:0.0:1789115448.852745:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d31a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d31a0 expref: 19 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115448.852763:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308241408 00000100:00100000:0.0:1789115448.852765:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308241408 00010000:00010000:0.0:1789115448.852778:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3199 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d3192 expref: 20 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115448.852793:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789115448.852800:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+20:3305:x1876023308241280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789115448.852807:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115448.852811:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d31a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d31a0 expref: 20 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.852819:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d31a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d31a0 expref: 20 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.852829:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115448.852856:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+20:3305:x1876023308241280:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115448.852862:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789115448.852876:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789115448.852882:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308241408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789115448.852889:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115448.852893:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3199 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d3192 expref: 19 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.852901:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3199 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d3192 expref: 19 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.852916:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115448.852939:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308241408:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115448.852945:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789115448.852972:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff912d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308241408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789115448.852978:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308241280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789115448.853096:0:11164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28e400/0xa47abda6516d31a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d31a0 expref: 18 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115448.853106:0:11164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876023308240768:0@lo:104: 00010000:00010000:1.0:1789115448.853116:0:11164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfd021c5c00/0xa47abda6516d3199 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d3192 expref: 17 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115448.853124:0:11164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876023308240896:0@lo:104: 00010000:00010000:1.0:1789115448.853132:0:11164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfd021c4c00/0xa47abda6516d318b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d3184 expref: 16 pid: 5843 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115448.853140:0:11164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3421a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876023308241024:0@lo:104: 00000100:00100000:1.0:1789115448.853676:0:11164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc88243c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876023308240640:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115448.853685:0:11164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3420780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876023308241152:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115448.853714:0:11164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115448.854964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115448.855030:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288281728 00000100:00100000:0.0:1789115448.855038:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288281728 00010000:00010000:0.0:1789115448.855068:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcda95dc00/0xa47abda6516d31bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a5a expref: 13 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115448.855104:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:0.0:1789115448.855112:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2352:x1876023288281728:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115448.855125:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115448.855131:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcda95dc00/0xa47abda6516d31bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a5a expref: 13 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.855141:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcda95dc00/0xa47abda6516d31bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a5a expref: 13 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.855156:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcda95dc00/0xa47abda6516d31bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a5a expref: 13 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.855169:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115448.855219:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:2352:x1876023288281728:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 107us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115448.855241:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:3.0:1789115448.857947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115448.858017:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288281856 00000100:00100000:0.0:1789115448.858028:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288281856 00010000:00010000:0.0:1789115448.858072:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d317d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a22 expref: 12 pid: 5844 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115448.858110:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1789115448.858119:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff911e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:2351:x1876023288281856:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115448.858134:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115448.858139:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d317d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a22 expref: 12 pid: 5844 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.858151:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d317d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a22 expref: 12 pid: 5844 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.858169:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d317d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a22 expref: 12 pid: 5844 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.858184:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.858192:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.858207:0:6713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.858214:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.858236:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.858243:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.858249:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115448.858253:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.858261:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.858281:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115448.858292:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789115448.858434:0:11164:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115448.858443:0:11164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115448.858450:0:11164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcedac7000/0xa47abda6516d31d8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115448.860073:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff911e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:2351:x1876023288281856:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1948us (2129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115448.860086:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00010000:00010000:3.0:1789115449.060335:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115450.087371:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789115450.339451:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789115450.339462:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcff92b000 from 7 10000000:01000000:1.0:1789115450.339469:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789115450.339532:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115450.339546:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115450.339569:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115450.339605:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3421a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308241664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789115450.339704:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115450.339792:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88763c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115450.340053:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308241664 00000100:00100000:2.0:1789115450.340064:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308241664 00000100:00100000:2.0:1789115450.340425:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789115450.340437:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308241664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789115450.340458:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115450.340491:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc1521800/0xa47abda6516d31e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d31df expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115450.340530:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1521800/0xa47abda6516d31e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d31df expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115450.340542:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc1521800/0xa47abda6516d31e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d31df expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115450.340553:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1521800, rc 0) 00000100:00100000:2.0:1789115450.340633:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308241664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115450.340641:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789115450.340726:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3421a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308241664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115450.340752:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d31e6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115450.340762:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d31e6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115450.340849:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd3421a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308241792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115450.340899:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115450.340929:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88763c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789115450.342292:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308241792 00000100:00100000:3.0:1789115450.342307:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308241792 00000100:00100000:3.0:1789115450.342431:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789115450.342457:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308241792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115450.342853:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308241792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 397us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115450.342862:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789115450.343781:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd3421a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308241792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789115450.343854:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308241920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789115450.344316:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115450.346172:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc4d556c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789115450.346280:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308241920 00000100:00100000:3.0:1789115450.346291:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308241920 00000100:00100000:1.0:1789115450.346358:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789115450.346456:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308241920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789115450.346781:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308241920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 411us (2466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115450.346797:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789115450.347057:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308241920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789115450.349797:0:11201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789115450.349990:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789115450.350018:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789115450.350033:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d31e6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115450.350055:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d31e6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115450.350067:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789115450.350071:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcd8ba8800 from 7 10000000:01000000:2.0:1789115450.350074:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789115450.350123:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115450.350132:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115450.350144:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115450.350176:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308242048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789115450.350264:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115450.350315:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a52180 going to sleep for 11 seconds 00000100:00100000:1.0:1789115450.350416:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308242048 00000100:00100000:1.0:1789115450.350426:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308242048 00000100:00100000:1.0:1789115450.350481:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789115450.350540:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308242048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115450.350679:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115450.350699:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedac6400/0xa47abda6516d31f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d31ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115450.350733:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedac6400/0xa47abda6516d31f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d31ed expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115450.350747:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedac6400/0xa47abda6516d31f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d31ed expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115450.350825:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6400, rc 0) 00000100:00100000:1.0:1789115450.350880:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308242048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 388us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115450.350894:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789115450.351116:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308242048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789115450.351137:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d31f4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115450.351148:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d31f4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115450.351223:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308242176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115450.351257:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115450.351300:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a52180 going to sleep for 11 seconds 00000100:00100000:1.0:1789115450.351368:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308242176 00000100:00100000:1.0:1789115450.351374:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308242176 00000100:00100000:1.0:1789115450.351514:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789115450.351523:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308242176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115450.351843:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308242176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115450.351851:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789115450.355994:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308242176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115450.356092:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308242304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115450.356194:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115450.356302:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a52180 going to sleep for 11 seconds 00000100:00100000:1.0:1789115450.358751:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308242304 00000100:00100000:1.0:1789115450.358771:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308242304 00000100:00100000:1.0:1789115450.359828:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789115450.359843:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308242304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115450.360193:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308242304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 352us (3998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115450.360204:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789115450.360490:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308242304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789115450.364368:0:11204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789115450.364469:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789115450.364493:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789115450.364509:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d31f4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115450.364524:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d31f4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789115450.364536:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789115450.364540:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcc65aa800 from 7 10000000:01000000:0.0:1789115450.364543:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789115450.364604:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115450.364614:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115450.364627:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115450.364670:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308242432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789115450.364761:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115450.364812:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc4d55c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115450.364929:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308242432 00000100:00100000:0.0:1789115450.364937:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308242432 00000100:00100000:0.0:1789115450.364987:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789115450.364998:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308242432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789115450.365029:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115450.365044:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3202 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d31fb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115450.365073:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3202 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d31fb expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115450.365085:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3202 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d31fb expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115450.365096:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28ea00, rc 0) 00000100:00100000:0.0:1789115450.365140:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308242432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115450.365147:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789115450.365200:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308242432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789115450.365217:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3202 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115450.365226:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3202 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115450.365280:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308242560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789115450.365309:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115450.365323:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc4d55c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115450.365336:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308242560 00000100:00100000:0.0:1789115450.365340:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308242560 00000100:00100000:0.0:1789115450.365363:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789115450.365369:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308242560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789115450.365713:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308242560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 342us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115450.365720:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789115450.365750:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308242560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789115450.365781:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308242688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789115450.365822:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115450.365835:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc4d55c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115450.365847:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308242688 00000100:00100000:0.0:1789115450.365851:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308242688 00000100:00100000:0.0:1789115450.365869:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789115450.365876:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308242688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789115450.366035:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308242688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115450.366043:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789115450.366080:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308242688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789115450.369492:0:11205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789115450.369940:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789115450.369964:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789115450.369979:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3202 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115450.369994:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3202 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115450.470757:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115450.470886:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288281984 00000100:00100000:0.0:1789115450.470898:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288281984 00000100:00100000:0.0:1789115450.470959:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 240 00000100:00100000:0.0:1789115450.470970:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:5593:x1876023288281984:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789115450.470997:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115450.471023:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d3209 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3a84 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115450.471059:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d3209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a84 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115450.471081:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d3209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a84 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115450.471093:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e200, rc 0) 00000100:00100000:0.0:1789115450.471180:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288281984:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 212us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115450.471251:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 240 00000100:00100000:1.0:1789115450.480356:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115450.480492:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288282112 00000100:00100000:0.0:1789115450.480505:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288282112 00000100:00100000:0.0:1789115450.480582:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:0.0:1789115450.480594:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288282112:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789115450.480977:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288282112:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 384us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115450.480983:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:3.0:1789115450.493718:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115450.493862:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288282240 00000100:00100000:0.0:1789115450.493873:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288282240 00000100:00100000:0.0:1789115450.493940:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 242 00000100:00100000:0.0:1789115450.493952:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288282240:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789115450.494556:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288282240:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 604us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115450.494576:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 242 00000100:00100000:0.0:1789115450.507205:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115450.507378:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288282368 00000100:00100000:1.0:1789115450.507502:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288282368 00000100:00100000:1.0:1789115450.507692:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:1.0:1789115450.507714:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288282368:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115450.507739:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115450.507763:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d3210 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3a8b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115450.507798:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d3210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a8b expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115450.507810:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d3210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a8b expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115450.507821:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6200, rc 0) 00000100:00100000:1.0:1789115450.508050:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288282368:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 331us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115450.508059:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:2.0:1789115450.511344:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115450.511482:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288282496 00000100:00100000:0.0:1789115450.511494:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288282496 00000100:00100000:0.0:1789115450.511720:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 244 00000100:00100000:0.0:1789115450.511739:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288282496:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789115450.512300:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288282496:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 560us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115450.512311:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 244 00000100:00100000:2.0:1789115450.515995:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115450.518162:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288282624 00000100:00100000:1.0:1789115450.518181:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288282624 00000100:00100000:1.0:1789115450.518377:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 245 00000100:00100000:1.0:1789115450.518427:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288282624:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115450.518752:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288282624:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 328us (2770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115450.518762:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 245 00010000:00010000:3.0:1789115451.107534:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115451.877911:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115451.878081:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115451.878108:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115451.878812:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288282752 00000100:00100000:0.0:1789115451.878823:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288282752 00000100:00100000:0.0:1789115451.878871:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 246 00000100:00100000:0.0:1789115451.878880:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2352:x1876023288282752:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115451.878949:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2352:x1876023288282752:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 70us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115451.878956:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 246 00000100:00100000:1.0:1789115451.879351:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288282880 00000100:00100000:1.0:1789115451.879356:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288282880 00000100:00100000:1.0:1789115451.879452:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288283008 00000100:00100000:1.0:1789115451.879457:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288283008 00000100:00100000:0.0:1789115451.879512:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:0.0:1789115451.879522:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288282880:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115451.879573:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288282880:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 53us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115451.879580:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00080000:2.0:1789115451.879789:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115451.879920:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:1.0:1789115451.879929:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2352:x1876023288283008:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115451.879972:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2352:x1876023288283008:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 44us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115451.879979:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:1.0:1789115452.068566:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308242816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789115452.068637:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115452.068814:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308242816 00000100:00100000:1.0:1789115452.068822:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308242816 00000100:00100000:1.0:1789115452.068882:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789115452.068892:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd34212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308242816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789115452.068924:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115452.068994:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd34212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308242816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (357us total) trans 0 rc 0/0 00000100:00080000:2.0:1789115452.069011:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789115452.069039:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789115452.069088:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcedabed00 x1876023308242816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115452.069107:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308242816:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789115452.131766:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789115452.394751:0:11361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789115453.092760:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308243200:0@lo:400:kworker.0 00000100:00100000:1.0:1789115453.092871:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115453.092970:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308243072:0@lo:400:kworker.0 00000100:00100000:0.0:1789115453.093041:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308242944:0@lo:400:kworker.0 00000100:00100000:1.0:1789115453.093250:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789115453.093259:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308243328:0@lo:400:kworker.0 00000100:00100000:2.0:1789115453.093363:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308243200 00000100:00100000:2.0:1789115453.093372:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308243200 00000100:00100000:2.0:1789115453.093486:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789115453.093499:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd3420780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308243200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115453.094719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115453.094786:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308243456:0@lo:400:kworker.0 00000100:00100000:3.0:1789115453.094852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115453.094861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115453.094931:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308243584:0@lo:400:kworker.0 00000100:00100000:1.0:1789115453.094949:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308242944 00000100:00100000:1.0:1789115453.094958:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308242944 00000100:00100000:3.0:1789115453.094989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789115453.095065:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115453.095094:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308243072 00000100:00100000:3.0:1789115453.095101:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308243072 00000100:00100000:3.0:1789115453.095151:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789115453.095159:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff910f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308243072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115453.095215:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff910f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308243072:12345-0@lo:400:kworker.0 Request processed in 57us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115453.095223:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789115453.095280:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308243072:0@lo:400:kworker.0 00000100:00100000:3.0:1789115453.095312:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308243328 00000100:00100000:3.0:1789115453.095316:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308243328 00000100:00100000:3.0:1789115453.095340:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308243584 00000100:00100000:3.0:1789115453.095343:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308243584 00000100:00100000:3.0:1789115453.095368:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789115453.095374:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd3421a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308243328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115453.095451:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd3421a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308243328:12345-0@lo:400:kworker.0 Request processed in 76us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115453.095457:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789115453.095482:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789115453.095488:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff912580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308243584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115453.095602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115453.095655:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308243456 00000100:00100000:0.0:1789115453.095671:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308243456 00000100:00100000:0.0:1789115453.095707:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789115453.095716:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308243456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115453.095771:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308243456:12345-0@lo:400:kworker.0 Request processed in 56us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115453.095784:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789115453.095830:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308243456:0@lo:400:kworker.0 00000100:00100000:3.0:1789115453.095871:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff912580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308243584:12345-0@lo:400:kworker.0 Request processed in 381us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115453.095882:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1789115453.095915:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcedabe940 x1876023308243328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789115453.095920:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789115453.095931:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789115453.095943:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308243328:0@lo:400:kworker.0 00010000:00080000:3.0:1789115453.095969:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcedabe580 x1876023308243584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115453.095982:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308243584:0@lo:400:kworker.0 00000100:00100000:1.0:1789115453.097623:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789115453.097656:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308242944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115453.097751:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308242944:12345-0@lo:400:kworker.0 Request processed in 101us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115453.097758:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789115453.098304:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308242944:0@lo:400:kworker.0 00000100:00100000:2.0:1789115453.098925:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd3420780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308243200:12345-0@lo:400:kworker.0 Request processed in 5426us (6051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115453.098937:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789115453.099551:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308243200:0@lo:400:kworker.0 00010000:00010000:2.0:1789115453.155606:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115453.603874:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789115453.607089:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff912d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308243712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789115453.607200:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115453.607493:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308243712 00000100:00100000:2.0:1789115453.607505:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308243712 00000100:00100000:2.0:1789115453.609254:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789115453.609277:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308243712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789115453.609328:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115453.609467:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308243712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 198us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115453.609485:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789115453.609524:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff912d00 x1876023308243712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115453.609561:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff912d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308243712:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789115454.180716:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115455.203640:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115456.228211:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115457.003506:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115457.003663:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115457.003708:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115457.003744:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288283264 00000100:00100000:3.0:1789115457.003756:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288283264 00000100:00100000:3.0:1789115457.003826:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288283392 00000100:00100000:3.0:1789115457.003830:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288283392 00000100:00100000:3.0:1789115457.003861:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:3.0:1789115457.003873:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288283264:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115457.003923:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288283136 00000100:00100000:1.0:1789115457.003929:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288283136 00000100:00100000:1.0:1789115457.003972:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 248 00000100:00100000:3.0:1789115457.003974:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288283264:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 101us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115457.003984:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2353:x1876023288283136:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115457.003988:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:3.0:1789115457.004016:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:1.0:1789115457.004025:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2353:x1876023288283136:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115457.004036:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 248 00000100:00100000:3.0:1789115457.004042:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff912d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288283392:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115457.004081:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff912d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288283392:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 44us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115457.004088:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00080000:3.0:1789115457.004111:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115457.188409:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789115457.188449:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308243840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789115457.188536:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115457.188789:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308243840 00000100:00100000:0.0:1789115457.188797:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308243840 00000100:00100000:0.0:1789115457.188872:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789115457.188887:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308243840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789115457.188929:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115457.188985:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308243840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115457.188994:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789115457.189045:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789115457.189092:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff9d7840 x1876023308243840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115457.189112:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308243840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789115457.256965:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115458.211690:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308244096:0@lo:400:kworker.0 00000100:00100000:1.0:1789115458.211714:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308244352:0@lo:400:kworker.0 00000100:00100000:2.0:1789115458.211910:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308244224:0@lo:400:kworker.0 00000100:00100000:2.0:1789115458.211983:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115458.212168:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaadbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308243968:0@lo:400:kworker.0 00000100:00100000:1.0:1789115458.212192:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115458.212249:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308244352 00000100:00100000:1.0:1789115458.212258:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308244352 00000100:00100000:0.0:1789115458.212276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115458.212340:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789115458.212348:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf1b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308244480:0@lo:400:kworker.0 00000100:00100000:1.0:1789115458.212359:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308244352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115458.212440:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115458.212482:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789115458.212489:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308244608:0@lo:400:kworker.0 00000100:00100000:0.0:1789115458.212769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115458.212876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115458.212940:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308244224 00000100:00100000:3.0:1789115458.212946:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308244224 00000100:00100000:1.0:1789115458.212948:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308244352:12345-0@lo:400:kworker.0 Request processed in 598us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115458.212957:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789115458.212989:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308244608 00000100:00100000:3.0:1789115458.212991:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308244480 00000100:00100000:3.0:1789115458.212993:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308244480 00000100:00100000:1.0:1789115458.212993:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308244608 00000100:00100000:3.0:1789115458.213007:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308244096 00000100:00100000:3.0:1789115458.213009:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308244096 00000100:00100000:1.0:1789115458.213017:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789115458.213021:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789115458.213023:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308244608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115458.213026:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308244224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115458.213059:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308244224:12345-0@lo:400:kworker.0 Request processed in 32us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115458.213059:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308244608:12345-0@lo:400:kworker.0 Request processed in 36us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115458.213067:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789115458.213067:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789115458.213080:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789115458.213085:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308244480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115458.213089:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308243968 00000100:00100000:1.0:1789115458.213103:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308243968 00000100:00100000:3.0:1789115458.213116:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308244480:12345-0@lo:400:kworker.0 Request processed in 31us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115458.213121:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789115458.213126:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789115458.213131:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789115458.213132:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308243968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115458.213136:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308244096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115458.213160:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308243968:12345-0@lo:400:kworker.0 Request processed in 28us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115458.213161:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308244096:12345-0@lo:400:kworker.0 Request processed in 24us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115458.213167:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789115458.213173:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1789115458.213201:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789115458.213206:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789115458.213226:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf192c0 x1876023308244352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115458.213228:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308244224:0@lo:400:kworker.0 00000100:00100000:1.0:1789115458.213238:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308244352:0@lo:400:kworker.0 00000100:00100000:3.0:1789115458.213259:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308244096:0@lo:400:kworker.0 00010000:00080000:1.0:1789115458.213263:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfbf19e00 x1876023308244608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115458.213273:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308244608:0@lo:400:kworker.0 00000100:00100000:1.0:1789115458.213282:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaadbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308243968:0@lo:400:kworker.0 00000100:00100000:1.0:1789115458.213304:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf1b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308244480:0@lo:400:kworker.0 00010000:00010000:1.0:1789115458.275658:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115458.724527:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789115458.724551:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8852940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308244736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789115458.724623:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115458.724980:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308244736 00000100:00100000:0.0:1789115458.724988:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308244736 00000100:00100000:0.0:1789115458.725046:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789115458.725056:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308244736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115458.725096:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115458.725145:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308244736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115458.725152:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789115458.725232:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc8852940 x1876023308244736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115458.725251:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8852940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308244736:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1789115458.871336:0:11606:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb9cdaab0 20000000:00000080:2.0:1789115458.871352:0:11606:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dfcfbfbcc00 uarg=0000000000000000 20000000:01000000:2.0:1789115458.871586:0:11606:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:2.0:1789115458.871593:0:11606:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:2.0:1789115458.871598:0:11606:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:0.0:1789115458.872120:0:11607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1789115458.872252:0:11606:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:3.0:1789115458.877324:0:11606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789115458.877462:0:11606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:3.0:1789115458.877547:0:11606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:3.0:1789115458.877566:0:11606:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789115458.877587:0:11606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115458.877605:0:11606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcc1521800/0xa47abda6516d31e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d31df expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115458.877613:0:11606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcedac6400/0xa47abda6516d31f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d31ed expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115458.877620:0:11606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3202 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d31fb expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115458.877628:0:11606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d3209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a84 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115458.877635:0:11606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d3210 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a8b expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115458.877643:0:11606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115458.877690:0:11606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d3210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a8b expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115458.877704:0:11606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d3210 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a8b expref: 12 pid: 5844 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115458.877717:0:11606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaadbc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876023308244864:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789115458.877871:0:11606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d3209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a84 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115458.877880:0:11606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d3209 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a84 expref: 12 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115458.877889:0:11606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaada580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876023308244992:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789115458.877920:0:11606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3202 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d31fb expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115458.877928:0:11606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3202 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d31fb expref: 18 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115458.877936:0:11606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8824f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876023308245120:0@lo:104: 00000100:00100000:3.0:1789115458.877978:0:11606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789115458.878017:0:11606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcedac6400/0xa47abda6516d31f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d31ed expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115458.878026:0:11606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcedac6400/0xa47abda6516d31f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d31ed expref: 18 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115458.878046:0:11606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc331680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876023308245248:0@lo:104: 00000100:00100000:3.0:1789115458.878072:0:11606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789115458.878095:0:11606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcc1521800/0xa47abda6516d31e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d31df expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115458.878102:0:11606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcc1521800/0xa47abda6516d31e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d31df expref: 18 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115458.878109:0:11606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876023308245376:0@lo:104: 00000100:00100000:3.0:1789115458.878132:0:11606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115458.878143:0:11606:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233240 going to sleep for 11 seconds 00000100:00100000:2.0:1789115458.878375:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789115458.878417:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308245120 00000100:00100000:2.0:1789115458.878423:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308245120 00000100:00100000:2.0:1789115458.878460:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308245248 00000100:00100000:2.0:1789115458.878463:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308245248 00000100:00100000:2.0:1789115458.878472:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308245376 00000100:00100000:2.0:1789115458.878474:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308245376 00000100:00100000:2.0:1789115458.878485:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789115458.878494:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc330f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+5:11606:x1876023308245120:12345-0@lo:104: 00010000:00010000:2.0:1789115458.878516:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3202 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115458.878571:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789115458.878577:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc330f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+5:11606:x1876023308245120:12345-0@lo:104: Request processed in 85us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115458.878583:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789115458.878600:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789115458.878605:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff971680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+4:11606:x1876023308245248:12345-0@lo:104: 00010000:00010000:2.0:1789115458.878621:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d31f4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115458.878654:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789115458.878659:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff971680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+4:11606:x1876023308245248:12345-0@lo:104: Request processed in 55us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115458.878665:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789115458.878679:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789115458.878684:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+3:11606:x1876023308245376:12345-0@lo:104: 00010000:00010000:2.0:1789115458.878691:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d31e6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115458.878722:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789115458.878727:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+3:11606:x1876023308245376:12345-0@lo:104: Request processed in 44us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115458.878733:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789115458.878895:0:11606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8824f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876023308245120:0@lo:104: 00000100:00100000:3.0:1789115458.878904:0:11606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc331680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876023308245248:0@lo:104: 00000100:00100000:3.0:1789115458.878910:0:11606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876023308245376:0@lo:104: 00010000:00010000:1.0:1789115458.879143:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789115458.879150:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3202 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879158:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f000 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:1.0:1789115458.879161:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d3202 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879169:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d3202 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115458.879175:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d3202 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115458.879180:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789115458.879219:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3202 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879227:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115458.879255:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3202 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879270:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfccf28f000/0xa47abda6516d31fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3202 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879283:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789115458.879287:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d31f4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879293:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1520400 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:1.0:1789115458.879296:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d31f4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879303:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d31f4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115458.879309:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d31f4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115458.879314:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789115458.879328:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d31f4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879334:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115458.879348:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d31f4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879356:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d31ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d31f4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879365:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115458.879374:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d31e6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879405:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7000 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:1.0:1789115458.879409:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d31e6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879416:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d31e6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115458.879422:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d31e6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115458.879427:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789115458.879441:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d31e6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879446:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115458.879452:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d31e6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879459:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d31df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d31e6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879474:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115458.879475:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115458.879477:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115458.879484:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115458.879491:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789115458.879512:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308245504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789115458.879548:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115458.879594:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308245632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789115458.879617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115458.879635:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789115458.879640:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308245760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789115458.879663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115458.879692:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308245504 00000100:00100000:1.0:1789115458.879696:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308245504 00010000:00010000:1.0:1789115458.879716:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3202 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d31fb expref: 19 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115458.879739:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308245632 00000100:00100000:1.0:1789115458.879742:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308245632 00010000:00010000:1.0:1789115458.879753:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcedac6400/0xa47abda6516d31f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d31ed expref: 20 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115458.879762:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308245760 00000100:00100000:1.0:1789115458.879764:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308245760 00010000:00010000:1.0:1789115458.879773:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcc1521800/0xa47abda6516d31e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d31df expref: 21 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115458.879785:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789115458.879791:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+21:3307:x1876023308245504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789115458.879802:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115458.879806:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3202 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d31fb expref: 21 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879815:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3202 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d31fb expref: 21 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879828:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28ea00/0xa47abda6516d3202 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d31fb expref: 21 pid: 5846 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879846:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115458.879877:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+20:3307:x1876023308245504:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115458.879883:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789115458.879903:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789115458.879909:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308245632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789115458.879916:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115458.879921:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcedac6400/0xa47abda6516d31f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d31ed expref: 19 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879929:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcedac6400/0xa47abda6516d31f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d31ed expref: 19 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879939:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcedac6400/0xa47abda6516d31f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d31ed expref: 19 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.879959:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115458.879978:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115458.880215:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:3305:x1876023308245632:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115458.880222:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789115458.880238:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789115458.880245:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:3305:x1876023308245760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789115458.880252:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115458.880256:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcc1521800/0xa47abda6516d31e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d31df expref: 17 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.880263:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcc1521800/0xa47abda6516d31e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d31df expref: 17 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.880278:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc1521800/0xa47abda6516d31e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d31df expref: 17 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.880287:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115458.880310:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+16:3305:x1876023308245760:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115458.880315:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789115458.881315:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308245760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789115458.881329:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308245632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789115458.881361:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308245504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789115458.883895:0:11606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaadbc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876023308244864:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115458.883908:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115458.884010:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115458.884061:0:11606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaada580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876023308244992:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115458.884098:0:11606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115458.884347:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288283520 00000100:00100000:2.0:1789115458.884354:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288283520 00000100:00100000:1.0:1789115458.884371:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288283648 00000100:00100000:1.0:1789115458.884375:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288283648 00010000:00010000:2.0:1789115458.884498:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d3210 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a8b expref: 14 pid: 5844 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115458.884551:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1789115458.884561:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+14:2352:x1876023288283520:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115458.884576:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115458.884582:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d3210 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a8b expref: 14 pid: 5844 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115458.884594:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d3210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a8b expref: 14 pid: 5844 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.884617:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d3209 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a84 expref: 14 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115458.884624:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d3210 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a8b expref: 14 pid: 5844 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115458.884638:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115458.884674:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1789115458.884681:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff970b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2353:x1876023288283648:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115458.884689:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789115458.884691:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2352:x1876023288283520:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 132us (785us total) trans 0 rc 0/0 00010000:00010000:1.0:1789115458.884693:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d3209 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a84 expref: 13 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115458.884698:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00010000:00010000:1.0:1789115458.884702:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d3209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a84 expref: 13 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.884712:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d3209 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a84 expref: 12 pid: 5846 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.885770:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115458.885778:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115458.885819:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115458.885833:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115458.885840:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115458.885847:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115458.885854:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc0030000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115458.885859:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115458.885867:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115458.885887:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115458.885897:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789115458.886078:0:11606:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115458.886097:0:11606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115458.886103:0:11606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc0030000/0xa47abda6516d3217 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115458.886226:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff970b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:2353:x1876023288283648:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1542us (2213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115458.886236:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00010000:00010000:1.0:1789115459.299898:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789115460.067968:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789115460.067977:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcff92b000 from 7 10000000:01000000:2.0:1789115460.067982:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789115460.068055:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115460.068069:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115460.068084:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115460.068119:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308245888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789115460.068212:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115460.068285:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc5d773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789115460.068519:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308245888 00000100:00100000:1.0:1789115460.068529:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308245888 00000100:00100000:1.0:1789115460.068597:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789115460.068608:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308245888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115460.068624:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115460.068641:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedac7c00/0xa47abda6516d3225 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d321e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115460.068670:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedac7c00/0xa47abda6516d3225 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d321e expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115460.068683:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedac7c00/0xa47abda6516d3225 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d321e expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115460.068693:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7c00, rc 0) 00000100:00100000:1.0:1789115460.068751:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308245888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115460.068758:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789115460.068933:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308245888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115460.068962:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3225 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115460.068991:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3225 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115460.069071:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308246016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115460.069115:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115460.069145:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789115460.069516:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308246016 00000100:00100000:1.0:1789115460.069522:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308246016 00000100:00100000:1.0:1789115460.069551:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789115460.069568:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308246016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115460.069889:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308246016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115460.069899:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789115460.069934:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308246016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115460.070446:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308246144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115460.070522:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115460.070566:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789115460.070581:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308246144 00000100:00100000:2.0:1789115460.070588:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308246144 00000100:00100000:2.0:1789115460.070673:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789115460.070684:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308246144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115460.070877:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308246144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115460.070895:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789115460.070929:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308246144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789115460.071428:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:11667:1876023308246272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789115460.071470:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115460.071505:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789115460.071580:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308246272 00000100:00100000:1.0:1789115460.071585:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308246272 00000100:00100000:1.0:1789115460.071678:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789115460.071688:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:11667:x1876023308246272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115460.071873:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:11667:x1876023308246272:12345-0@lo:502:llog_process_th.0 Request processed in 187us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115460.071880:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789115460.072164:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:11667:1876023308246272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789115460.072189:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789115460.072201:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115460.072204:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789115460.072212:0:11667:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dfcff92b000 00000020:00000080:3.0:1789115460.072215:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789115460.072305:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:11667:1876023308246400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789115460.072347:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115460.072368:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789115460.073342:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308246400 00000100:00100000:1.0:1789115460.073350:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308246400 00000100:00100000:1.0:1789115460.073416:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789115460.073424:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:11667:x1876023308246400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115460.073675:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:11667:x1876023308246400:12345-0@lo:502:llog_process_th.0 Request processed in 251us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115460.073684:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789115460.074740:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:11667:1876023308246400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789115460.074784:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789115460.074800:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115460.074807:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789115460.074814:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789115460.076133:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789115460.076231:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789115460.076245:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3225 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115460.076260:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3225 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115460.076274:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789115460.076277:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcd8ba8800 from 7 10000000:01000000:2.0:1789115460.076281:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789115460.076329:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115460.076340:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115460.076352:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115460.076398:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308246528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789115460.076479:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115460.076534:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc5d773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115460.078642:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308246528 00000100:00100000:0.0:1789115460.078661:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308246528 00000100:00100000:3.0:1789115460.078732:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789115460.078757:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308246528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115460.078778:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115460.078802:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc0031400/0xa47abda6516d3233 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d322c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115460.078836:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc0031400/0xa47abda6516d3233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d322c expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115460.078848:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc0031400/0xa47abda6516d3233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d322c expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115460.078859:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc0031400, rc 0) 00000100:00100000:3.0:1789115460.078956:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308246528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (2472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115460.078990:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308246528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115460.079014:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3233 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115460.079026:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3233 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115460.079228:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308246656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115460.079281:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115460.079318:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfbc1c54b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789115460.079352:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308246656 00000100:00100000:1.0:1789115460.079356:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308246656 00000100:00100000:3.0:1789115460.079938:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789115460.079978:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789115460.079987:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308246656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115460.080319:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308246656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115460.080327:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789115460.080649:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308246656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789115460.080705:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8851680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308246784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789115460.080755:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115460.080781:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c9000 going to sleep for 11 seconds 00000100:00100000:0.0:1789115460.080796:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308246784 00000100:00100000:0.0:1789115460.080801:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308246784 00000100:00100000:0.0:1789115460.080838:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789115460.080847:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308246784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789115460.081285:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308246784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 437us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115460.081294:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789115460.081321:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8851680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308246784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115460.081807:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50ea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:11670:1876023308246912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115460.081851:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115460.081912:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfbc1c546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789115460.082109:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308246912 00000100:00100000:3.0:1789115460.082115:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308246912 00000100:00100000:3.0:1789115460.082193:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789115460.082211:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:11670:x1876023308246912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789115460.082429:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:11670:x1876023308246912:12345-0@lo:502:llog_process_th.0 Request processed in 210us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115460.082437:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789115460.082526:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50ea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:11670:1876023308246912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789115460.082553:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115460.082564:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115460.082567:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789115460.082574:0:11670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dfcd8ba8800 00000020:00000080:1.0:1789115460.082576:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789115460.082665:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50ea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:11670:1876023308247040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115460.082702:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115460.082870:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308247040 00000100:00100000:0.0:1789115460.082875:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308247040 00000100:00100000:0.0:1789115460.082898:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789115460.082905:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:11670:x1876023308247040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789115460.083049:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:11670:x1876023308247040:12345-0@lo:502:llog_process_th.0 Request processed in 144us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115460.083057:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789115460.083118:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfbc1c546c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115460.083132:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50ea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:11670:1876023308247040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789115460.083151:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789115460.083156:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789115460.083158:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789115460.083163:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789115460.083519:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789115460.083541:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789115460.083553:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3233 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115460.083566:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3233 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115460.083578:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789115460.083581:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcc65aa800 from 7 10000000:01000000:3.0:1789115460.083584:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789115460.083616:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115460.083625:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115460.083635:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115460.083651:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308247168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789115460.083684:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115460.083704:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233240 going to sleep for 11 seconds 00000100:00100000:3.0:1789115460.083718:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308247168 00000100:00100000:3.0:1789115460.083721:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308247168 00000100:00100000:3.0:1789115460.083751:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789115460.083757:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308247168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115460.083767:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115460.083780:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc0031800/0xa47abda6516d3241 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d323a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115460.083804:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc0031800/0xa47abda6516d3241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d323a expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115460.083816:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc0031800/0xa47abda6516d3241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d323a expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115460.083826:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc0031800, rc 0) 00000100:00100000:3.0:1789115460.083855:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308247168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115460.083863:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789115460.083893:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308247168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115460.083907:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3241 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115460.083917:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3241 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115460.083977:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308247296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115460.084004:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115460.084018:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8b84240 going to sleep for 11 seconds 00000100:00100000:3.0:1789115460.084092:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308247296 00000100:00100000:3.0:1789115460.084097:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308247296 00000100:00100000:3.0:1789115460.084124:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789115460.084131:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308247296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115460.084401:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308247296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115460.084408:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789115460.084565:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308247296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115460.084595:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308247424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115460.084632:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115460.084646:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8b84240 going to sleep for 11 seconds 00000100:00100000:3.0:1789115460.084658:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308247424 00000100:00100000:3.0:1789115460.084662:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308247424 00000100:00100000:3.0:1789115460.084682:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789115460.084688:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308247424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115460.084815:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308247424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115460.084822:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789115460.084862:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308247424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115460.085273:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:11671:1876023308247552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789115460.085315:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115460.085377:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8b84480 going to sleep for 11 seconds 00000100:00100000:1.0:1789115460.085565:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308247552 00000100:00100000:1.0:1789115460.085571:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308247552 00000100:00100000:0.0:1789115460.085624:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789115460.085635:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:11671:x1876023308247552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789115460.085803:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:11671:x1876023308247552:12345-0@lo:502:llog_process_th.0 Request processed in 171us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115460.085810:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789115460.085894:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:11671:1876023308247552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789115460.085918:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789115460.085929:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115460.085932:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789115460.085944:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dfcc65aa800 00000020:00000080:3.0:1789115460.085947:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789115460.086586:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:11671:1876023308247680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789115460.086631:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115460.086665:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd0dca900 going to sleep for 11 seconds 00000100:00100000:0.0:1789115460.086712:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308247680 00000100:00100000:0.0:1789115460.086717:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308247680 00000100:00100000:0.0:1789115460.086754:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789115460.086762:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:11671:x1876023308247680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789115460.086928:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:11671:x1876023308247680:12345-0@lo:502:llog_process_th.0 Request processed in 167us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115460.086936:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789115460.087125:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:11671:1876023308247680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789115460.087149:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789115460.087158:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115460.087159:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789115460.087163:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789115460.087335:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789115460.087352:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789115460.087364:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3241 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115460.087376:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3241 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115460.324280:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115460.327133:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115460.327249:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288283776 00000100:00100000:0.0:1789115460.327263:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288283776 00000100:00100000:0.0:1789115460.327333:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 265 00000100:00100000:0.0:1789115460.327344:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:5593:x1876023288283776:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789115460.327366:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115460.327424:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d3248 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3a92 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115460.327465:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d3248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a92 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115460.327507:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d3248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a92 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115460.327519:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e600, rc 0) 00000100:00100000:0.0:1789115460.327604:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288283776:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 261us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115460.327611:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 265 00000100:00100000:2.0:1789115460.330046:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115460.330173:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288283904 00000100:00100000:1.0:1789115460.330256:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288283904 00000100:00100000:1.0:1789115460.330321:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 266 00000100:00100000:1.0:1789115460.330334:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288283904:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115460.330898:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288283904:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 565us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115460.330909:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 266 00000100:00100000:1.0:1789115460.336130:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115460.336213:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288284032 00000100:00100000:3.0:1789115460.336225:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288284032 00000100:00100000:3.0:1789115460.336287:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 267 00000100:00100000:3.0:1789115460.336299:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288284032:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115460.336680:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288284032:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 381us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115460.336690:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 267 00000100:00100000:3.0:1789115460.340148:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115460.340280:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288284160 00000100:00100000:1.0:1789115460.340308:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288284160 00000100:00100000:1.0:1789115460.340374:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 268 00000100:00100000:1.0:1789115460.340669:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:9514:x1876023288284160:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789115460.341021:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:9514:x1876023288284160:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 636us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115460.341030:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 268 00000100:00100000:2.0:1789115460.344413:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115460.344791:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288284288 00000100:00100000:3.0:1789115460.344809:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288284288 00000100:00100000:3.0:1789115460.344902:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 269 00000100:00100000:3.0:1789115460.344915:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:9514:x1876023288284288:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789115460.345481:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:9514:x1876023288284288:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 565us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115460.345499:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 269 00000100:00100000:3.0:1789115460.348955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115460.349425:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288284416 00000100:00100000:1.0:1789115460.349442:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288284416 00000100:00100000:1.0:1789115460.349522:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 270 00000100:00100000:1.0:1789115460.349534:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288284416:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115460.349556:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115460.349579:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedac7e00/0xa47abda6516d324f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3a99 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115460.349625:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedac7e00/0xa47abda6516d324f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a99 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115460.349638:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedac7e00/0xa47abda6516d324f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a99 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115460.349648:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7e00, rc 0) 00000100:00100000:1.0:1789115460.349727:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288284416:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 195us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115460.349734:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 270 00000100:00100000:0.0:1789115460.353645:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115460.353777:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288284544 00000100:00100000:3.0:1789115460.353794:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288284544 00000100:00100000:3.0:1789115460.353917:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 271 00000100:00100000:3.0:1789115460.353929:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288284544:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115460.354314:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288284544:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 387us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115460.354332:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 271 00000100:00100000:2.0:1789115460.356724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115460.356805:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288284672 00000100:00100000:0.0:1789115460.356820:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288284672 00000100:00100000:0.0:1789115460.356883:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 272 00000100:00100000:0.0:1789115460.356895:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288284672:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789115460.357252:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288284672:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 359us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115460.357260:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 272 00000100:00100000:0.0:1789115460.360696:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115460.360804:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288284800 00000100:00100000:3.0:1789115460.360817:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288284800 00000100:00100000:3.0:1789115460.360887:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 273 00000100:00100000:3.0:1789115460.360900:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:9517:x1876023288284800:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789115460.361258:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:9517:x1876023288284800:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 360us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115460.361268:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 273 00000100:00100000:3.0:1789115460.364591:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115460.364700:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288284928 00000100:00100000:0.0:1789115460.364712:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288284928 00000100:00100000:0.0:1789115460.364781:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 274 00000100:00100000:0.0:1789115460.364792:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:9517:x1876023288284928:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789115460.365132:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:9517:x1876023288284928:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 340us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115460.365151:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 274 00010000:00010000:0.0:1789115461.349914:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115462.127659:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115462.127724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115462.127758:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115462.127814:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288285056 00000100:00100000:0.0:1789115462.127826:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288285056 00000100:00100000:1.0:1789115462.127845:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288285184 00000100:00100000:1.0:1789115462.127852:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288285184 00000100:00100000:0.0:1789115462.127896:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 275 00000100:00100000:0.0:1789115462.127911:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2353:x1876023288285056:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115462.127912:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288285312 00000100:00100000:1.0:1789115462.127917:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288285312 00000100:00100000:1.0:1789115462.127959:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:1.0:1789115462.127967:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288285184:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115462.128009:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2353:x1876023288285056:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 102us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115462.128017:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288285184:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 49us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115462.128024:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 275 00000100:00100000:1.0:1789115462.128030:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:1.0:1789115462.128066:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:1.0:1789115462.128073:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288285312:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:0.0:1789115462.128085:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115462.128103:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288285312:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115462.128111:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:1.0:1789115462.309718:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789115462.309749:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308247808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789115462.310312:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115462.310803:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308247808 00000100:00100000:2.0:1789115462.310815:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308247808 00000100:00100000:2.0:1789115462.310915:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789115462.310926:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308247808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789115462.310971:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115462.311123:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308247808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 199us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115462.311133:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789115462.311194:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcf50ea940 x1876023308247808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115462.311218:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308247808:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789115462.311463:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789115462.372936:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115463.331747:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789115463.332261:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789115463.332291:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc2d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308248320:0@lo:400:kworker.0 00000100:00100000:2.0:1789115463.332410:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115463.332527:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308248320 00000100:00100000:2.0:1789115463.332537:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308248320 00000100:00100000:2.0:1789115463.332603:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789115463.332614:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308248320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115463.332678:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308248320:12345-0@lo:400:kworker.0 Request processed in 65us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115463.332687:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789115463.333900:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc0861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876023308248192:0@lo:400:kworker.0 00000100:00100000:3.0:1789115463.334041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115463.334091:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789115463.334099:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff971680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308248064:0@lo:400:kworker.0 00000100:00100000:3.0:1789115463.334126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115463.334146:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc2d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308248576:0@lo:400:kworker.0 00000100:00100000:3.0:1789115463.334174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115463.334179:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876023308248448:0@lo:400:kworker.0 00000100:00100000:0.0:1789115463.334220:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789115463.334272:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc2d61c0 x1876023308248320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115463.334287:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc2d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308248320:0@lo:400:kworker.0 00000100:00100000:3.0:1789115463.334481:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308248192 00000100:00100000:3.0:1789115463.334489:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308248192 00000100:00100000:2.0:1789115463.334506:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308248576 00000100:00100000:2.0:1789115463.334512:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308248576 00000100:00100000:3.0:1789115463.334556:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308248064 00000100:00100000:2.0:1789115463.334560:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789115463.334571:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308248576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115463.334577:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308248064 00000100:00100000:3.0:1789115463.334598:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308248448 00000100:00100000:3.0:1789115463.334601:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308248448 00000100:00100000:3.0:1789115463.334621:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789115463.334628:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876023308248192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115463.334640:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308248576:12345-0@lo:400:kworker.0 Request processed in 70us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115463.334649:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789115463.334673:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876023308248192:12345-0@lo:400:kworker.0 Request processed in 44us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115463.334681:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1789115463.334699:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789115463.334703:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1789115463.334707:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115463.334714:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308247936:0@lo:400:kworker.0 00000100:00100000:3.0:1789115463.334725:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308248064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115463.334754:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308248064:12345-0@lo:400:kworker.0 Request processed in 44us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115463.334761:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789115463.334773:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789115463.334781:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876023308248448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115463.334821:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff971680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308248064:0@lo:400:kworker.0 00000100:00100000:3.0:1789115463.334822:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876023308248448:12345-0@lo:400:kworker.0 Request processed in 41us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115463.334833:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:2.0:1789115463.334841:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc2d7840 x1876023308248576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115463.334851:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc2d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308248576:0@lo:400:kworker.0 00000100:00100000:3.0:1789115463.334865:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876023308248448:0@lo:400:kworker.0 00000100:00100000:2.0:1789115463.334868:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc0861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876023308248192:0@lo:400:kworker.0 00000100:00100000:1.0:1789115463.334971:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115463.335141:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308247936 00000100:00100000:3.0:1789115463.335146:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308247936 00000100:00100000:3.0:1789115463.335185:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789115463.335193:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3307:x1876023308247936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115463.335457:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3307:x1876023308247936:12345-0@lo:400:kworker.0 Request processed in 264us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115463.335465:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789115463.335656:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308247936:0@lo:400:kworker.0 00010000:00010000:1.0:1789115463.403288:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115463.847810:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc88521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308248704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789115463.847890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115463.848035:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308248704 00000100:00100000:0.0:1789115463.848043:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308248704 00000100:00100000:0.0:1789115463.848095:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789115463.848104:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308248704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115463.848143:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115463.848201:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308248704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115463.848208:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1789115463.848332:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc88521c0 x1876023308248704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115463.848353:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc88521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308248704:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1789115464.293298:0:11808:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 04:31:02 (1789115462) === 00010000:00010000:2.0:1789115464.423691:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115465.450560:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115465.721776:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115465.721869:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115465.722016:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288285568 00000100:00100000:1.0:1789115465.722026:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288285568 00000100:00100000:1.0:1789115465.722089:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:1.0:1789115465.722099:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6dbf7574-92fb-4b89-af78-41319f924699+6:9883:x1876023288285568:12345-192.168.203.31@tcp:700:mkdir.0 00000100:00100000:1.0:1789115465.722175:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6dbf7574-92fb-4b89-af78-41319f924699+6:9883:x1876023288285568:12345-192.168.203.31@tcp:700:mkdir.0 Request processed in 77us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115465.722194:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1789115465.722302:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288285440 00000100:00100000:0.0:1789115465.722307:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288285440 00000100:00100000:0.0:1789115465.722349:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:0.0:1789115465.722357:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2351:x1876023288285440:12345-192.168.203.31@tcp:41:mkdir.0 00000004:00000024:0.0:1789115465.722534:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789115465.722585:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2351:x1876023288285440:12345-192.168.203.31@tcp:41:mkdir.0 Request processed in 230us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115465.722592:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00080000:3.0:1789115465.723135:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115465.727691:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115465.727836:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288285824 00000100:00100000:3.0:1789115465.727845:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288285824 00000100:00100000:3.0:1789115465.727903:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:3.0:1789115465.727913:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:9883:x1876023288285824:12345-192.168.203.31@tcp:36:mkdir.0 00010000:00010000:3.0:1789115465.727976:0:8213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115465.728044:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d30f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a0d expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.728061:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044fa00) 00010000:00010000:3.0:1789115465.728072:0:8213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789115465.728357:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030200/0xa47abda6516d3256 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.728370:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030200/0xa47abda6516d3256 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.728413:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030200/0xa47abda6516d3256 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.728464:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d325d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.728471:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d325d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.728485:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d325d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115465.730300:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789115465.730318:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030200/0xa47abda6516d3256 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.730328:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030200/0xa47abda6516d3256 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.730336:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030200/0xa47abda6516d3256 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.730342:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc0030200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115465.730346:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030200/0xa47abda6516d3256 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.730354:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030200/0xa47abda6516d3256 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.730368:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcf2157b00) 00010000:00010000:3.0:1789115465.730371:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115465.730374:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030200/0xa47abda6516d3256 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.730414:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030200/0xa47abda6516d3256 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789115465.730437:0:8213:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000098dc8210 reply state 00000000aa34863a transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d325d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115465.730472:0:8213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789115465.730575:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:9883:x1876023288285824:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 2660us (2889us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789115465.730585:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00010000:00010000:0.0:1789115465.738112:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d325d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.738129:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d325d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.738137:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d325d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.738144:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc0030400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115465.738158:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d325d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.738166:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d325d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.738182:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8dfcf2157800) 00010000:00010000:0.0:1789115465.738185:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115465.738190:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d325d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.738196:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d325d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115465.746101:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115465.746334:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288285952 00000100:00100000:0.0:1789115465.746358:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288285952 00000100:00100000:1.0:1789115465.746504:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:1.0:1789115465.746517:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:9884:x1876023288285952:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:1.0:1789115465.746599:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115465.746619:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3264 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3aa0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.746674:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d326b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.746693:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d326b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.746702:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d326b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115465.746751:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789115465.746753:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115465.746883:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d326b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.746905:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3264 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aa0 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.746917:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d326b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aa0 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.746931:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01ae700) 00010000:00010000:1.0:1789115465.746934:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789115465.746936:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7200, rc 0) 00000100:00100000:1.0:1789115465.746982:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:9884:x1876023288285952:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 470us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115465.746987:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1789115465.761127:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115465.761162:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288286208 00000100:00100000:0.0:1789115465.761170:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288286208 00000100:00100000:0.0:1789115465.761236:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1789115465.761246:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8850780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+7:9884:x1876023288286208:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:0.0:1789115465.761298:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115465.761325:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d326b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aa0 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.761341:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01ae700) 00010000:00010000:0.0:1789115465.761360:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115465.761404:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3272 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.761417:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3272 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.761428:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3272 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789115465.762116:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e703d6c9 reply state 0000000044e4783d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3272 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115465.762131:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789115465.762154:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1789115465.762337:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8850780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+8:9884:x1876023288286208:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 1091us (1219us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789115465.762344:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00010000:00010000:1.0:1789115465.767994:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3272 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.768013:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3272 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.768021:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3272 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.768028:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115465.768032:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3272 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.768040:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3272 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.768056:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:1.0:1789115465.768698:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789115465.768705:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3272 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.768712:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3272 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115465.812287:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115465.812451:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288286336 00000100:00100000:1.0:1789115465.812471:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288286336 00000100:00100000:1.0:1789115465.812520:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1789115465.812530:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:9885:x1876023288286336:12345-192.168.203.31@tcp:101:chown.0 00010000:00010000:1.0:1789115465.812554:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115465.812576:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3279 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3aa7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.812645:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3280 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.812658:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.812670:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115465.812747:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789115465.812752:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115465.812812:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.812838:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3279 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aa7 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.812856:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3280 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aa7 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.812865:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01ae200) 00010000:00010000:1.0:1789115465.812874:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789115465.812878:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7a00, rc 0) 00000100:00100000:1.0:1789115465.812946:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:9885:x1876023288286336:12345-192.168.203.31@tcp:101:chown.0 Request processed in 417us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115465.812953:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1789115465.821343:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115465.821481:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288286464 00000100:00100000:3.0:1789115465.821491:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288286464 00000100:00100000:3.0:1789115465.821555:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:3.0:1789115465.821565:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8851680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+8:9885:x1876023288286464:12345-192.168.203.31@tcp:101:chown.0 00010000:00010000:3.0:1789115465.821583:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115465.821610:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030200/0xa47abda6516d3287 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3aae expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821671:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030e00/0xa47abda6516d328e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821684:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030e00/0xa47abda6516d328e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821696:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030e00/0xa47abda6516d328e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821712:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d3295 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821719:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d3295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821725:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d3295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821857:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d329c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821867:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d329c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821874:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d329c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115465.821913:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1789115465.821917:0:8213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789115465.821953:0:8213:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d329c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821964:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030e00/0xa47abda6516d328e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821968:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030e00/0xa47abda6516d328e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821973:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030e00/0xa47abda6516d328e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821977:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc0030e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115465.821979:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030e00/0xa47abda6516d328e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821984:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030e00/0xa47abda6516d328e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.821992:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01ae200) 00010000:00010000:3.0:1789115465.821998:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115465.822002:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030e00/0xa47abda6516d328e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.822006:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030e00/0xa47abda6516d328e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.822017:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d3295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.822020:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d3295 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.822024:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d3295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.822027:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc0030400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115465.822028:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d3295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.822031:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d3295 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.822035:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8dfcf2157b00) 00010000:00010000:3.0:1789115465.822037:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115465.822038:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d3295 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.822041:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030400/0xa47abda6516d3295 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.822063:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc0030200/0xa47abda6516d3287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aae expref: 10 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.822080:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d329c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aae expref: 9 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.822084:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dfcf2157300) 00010000:00010000:3.0:1789115465.822086:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789115465.822087:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ea200, rc 0) 00000100:00100000:3.0:1789115465.822140:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8851680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+9:9885:x1876023288286464:12345-192.168.203.31@tcp:101:chown.0 Request processed in 578us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115465.822145:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:2.0:1789115465.830127:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115465.833575:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288286720 00000100:00100000:1.0:1789115465.833589:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288286720 00000100:00100000:1.0:1789115465.833653:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1789115465.833663:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+9:9885:x1876023288286720:12345-192.168.203.31@tcp:36:chown.0 00010000:00010000:1.0:1789115465.833715:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115465.833742:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d329c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aae expref: 9 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.833761:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dfcf2157300) 00010000:00010000:1.0:1789115465.833783:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789115465.833808:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d32a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.833820:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d32a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.833829:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d32a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789115465.896653:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000040ab49de reply state 0000000071c992e9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d32a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115465.896672:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789115465.896826:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000001:00080000:2.0:1789115465.896954:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1789115465.896967:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00080000:0.0:1789115465.897247:0:5852:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789115465.897276:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:9885:x1876023288286720:12345-192.168.203.31@tcp:36:chown.0 Request processed in 63610us (67154us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789115465.897284:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00010000:00010000:1.0:1789115465.897412:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d32a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.897422:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d32a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.897442:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d32a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.897448:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115465.897453:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d32a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.897476:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d32a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.897491:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dfcd01ae900) 00010000:00010000:1.0:1789115465.897494:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789115465.897499:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d32a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.897505:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d32a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115465.918502:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115465.918608:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288286848 00000100:00100000:3.0:1789115465.918617:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288286848 00000100:00100000:3.0:1789115465.918673:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1789115465.918683:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:9886:x1876023288286848:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:3.0:1789115465.918705:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115465.918726:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d32aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3ab5 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789115465.921513:0:8213:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2740us 00010000:00010000:3.0:1789115465.939308:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d32b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.939333:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d32b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.939345:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d32b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.939373:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d32b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.939401:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d32b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.939411:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d32b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.940238:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d32bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.940252:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d32bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.940260:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d32bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115465.940347:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789115465.940352:0:8213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789115465.941194:0:8213:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d32bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941213:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d32b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941220:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d32b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941228:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d32b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941244:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115465.941249:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d32b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941257:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d32b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941272:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01ae200) 00010000:00010000:3.0:1789115465.941275:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115465.941280:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d32b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941286:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d32b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941298:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d32b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941304:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d32b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941311:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d32b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941316:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115465.941319:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d32b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941325:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d32b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941342:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8dfcf2157a00) 00010000:00010000:3.0:1789115465.941345:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115465.941348:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d32b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941355:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d32b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941783:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d32aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ab5 expref: 8 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941801:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d32bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ab5 expref: 7 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115465.941809:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dfcf2157b00) 00010000:00010000:3.0:1789115465.941812:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789115465.941814:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb600, rc 0) 00000100:00100000:3.0:1789115465.942001:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:9886:x1876023288286848:12345-192.168.203.31@tcp:101:touch.500 Request processed in 23252us (23440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115465.942011:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1789115465.946608:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115465.946957:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288287104 00000100:00100000:0.0:1789115465.946966:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288287104 00000100:00100000:0.0:1789115465.947025:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1789115465.947036:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+7:9886:x1876023288287104:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:0.0:1789115465.947056:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115465.947075:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d32c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3abc expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.947466:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d32cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.947482:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d32cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.947493:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d32cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.947541:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d32d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.947549:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d32d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.947563:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d32d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789115465.948325:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1789115465.948648:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d32db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.948661:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d32db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.948670:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d32db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.948704:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d32cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.948711:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d32cd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.948717:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d32cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.948722:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115465.948726:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d32cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.948733:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d32cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.948744:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dfcf2157b00) 00010000:00010000:0.0:1789115465.948748:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115465.948759:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d32cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.948765:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d32cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789115465.948779:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000583a3a0b reply state 000000006a604ba5 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d32d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115465.948787:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789115465.948822:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d32c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3abc expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.948837:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d32db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3abc expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.948844:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:0.0:1789115465.948846:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115465.948849:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e200, rc 0) 00000100:00100000:0.0:1789115465.948933:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+10:9886:x1876023288287104:12345-192.168.203.31@tcp:101:touch.500 Request processed in 1898us (2333us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789115465.948941:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00010000:00010000:1.0:1789115465.952129:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d32d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.952146:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d32d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.952154:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d32d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.952160:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115465.952164:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d32d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.952190:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d32d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.952207:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff8dfcd044f600) 00010000:00010000:1.0:1789115465.952210:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115465.952215:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d32d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.952221:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d32d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115465.956069:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115465.956164:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288287360 00000100:00100000:0.0:1789115465.956174:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288287360 00000100:00100000:0.0:1789115465.956227:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:0.0:1789115465.956237:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+9:9886:x1876023288287360:12345-192.168.203.31@tcp:36:touch.500 00010000:00010000:0.0:1789115465.956296:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115465.956325:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d32db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3abc expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.956358:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:0.0:1789115465.956370:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115465.956429:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d32e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.956441:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d32e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.956451:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d32e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789115465.957078:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d5e37404 reply state 0000000021a8abb8 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d32e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115465.957161:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789115465.957272:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+10:9886:x1876023288287360:12345-192.168.203.31@tcp:36:touch.500 Request processed in 1035us (1209us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789115465.957280:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1789115465.961236:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:1.0:1789115465.961481:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d32e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.961495:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d32e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.961504:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d32e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.961511:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115465.961517:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d32e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115465.961519:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288287488 00010000:00010000:1.0:1789115465.961527:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d32e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115465.961535:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288287488 00010000:00010000:1.0:1789115465.961543:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:1.0:1789115465.961548:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115465.961553:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d32e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115465.961573:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d32e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115465.961608:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1789115465.961624:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+9:9886:x1876023288287488:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:0.0:1789115465.961647:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115465.961665:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d32f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3ac3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.961732:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d32f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ac3 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.961758:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d32f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ac3 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115465.961778:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dfcd044f200) 00010000:00010000:0.0:1789115465.961781:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789115465.961784:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f600, rc 0) 00000100:00100000:0.0:1789115465.961841:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+10:9886:x1876023288287488:12345-192.168.203.31@tcp:101:touch.500 Request processed in 224us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115465.961848:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:2.0:1789115465.964584:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115465.964885:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288287616 00000100:00100000:0.0:1789115465.964894:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288287616 00000100:00100000:0.0:1789115465.964988:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1789115465.964995:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1876023288287616:12345-192.168.203.31@tcp:8:touch.500 00010000:00080000:0.0:1789115465.965024:0:6885:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:0.0:1789115465.965054:0:6885:0:(genops.c:1385:class_connect()) connect: client 6dbf7574-92fb-4b89-af78-41319f924699, cookie 0xa47abda6516d32f7 00002000:00100000:0.0:1789115465.965064:0:6885:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6dbf7574-92fb-4b89-af78-41319f924699/ffff8dfce07e5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398e ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789115465.965087:0:6885:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:0.0:1789115465.965325:0:6885:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789115465.965355:0:6885:0:(import.c:65:import_set_state_nolock()) ffff8dfce07e6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789115465.965475:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2349:x1876023288287616:12345-192.168.203.31@tcp:8:touch.500 Request processed in 478us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115465.965484:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1789115465.967514:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115465.967588:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288287744 00000100:00100000:0.0:1789115465.967596:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288287744 00000100:00080000:3.0:1789115465.967672:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789115465.967677:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1789115465.967685:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:0:x1876023288287744:12345-192.168.203.31@tcp:2:touch.500 00000001:00080000:3.0:1789115466.009234:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1789115466.009251:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6dbf7574-92fb-4b89-af78-41319f924699 00000100:00100000:1.0:1789115466.009536:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:0:x1876023288287744:12345-192.168.203.31@tcp:2:touch.500 Request processed in 41844us (42021us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789115466.009547:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:1.0:1789115466.013271:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115466.013510:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288288000 00000100:00100000:0.0:1789115466.013519:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288288000 00000100:00100000:0.0:1789115466.013584:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1789115466.013595:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+10:9886:x1876023288288000:12345-192.168.203.31@tcp:35:touch.500 00000100:00100000:0.0:1789115466.013958:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+11:9886:x1876023288288000:12345-192.168.203.31@tcp:35:touch.500 Request processed in 364us (693us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789115466.013967:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:3.0:1789115466.052499:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115466.052843:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288288128 00000100:00100000:0.0:1789115466.052853:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288288128 00000100:00100000:0.0:1789115466.052915:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1789115466.052926:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+11:9887:x1876023288288128:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:0.0:1789115466.052960:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115466.052980:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d32fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3aca expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.053041:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3305 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.053055:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.053067:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115466.053127:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789115466.053132:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115466.053194:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.053223:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d32fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aca expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.053240:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3305 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aca expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.053249:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dfcf2157b00) 00010000:00010000:0.0:1789115466.053252:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789115466.053255:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28ea00, rc 0) 00000100:00100000:0.0:1789115466.053329:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+12:9887:x1876023288288128:12345-192.168.203.31@tcp:101:rm.0 Request processed in 405us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115466.053336:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:1.0:1789115466.058776:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115466.058880:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288288384 00000100:00100000:2.0:1789115466.058892:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288288384 00000100:00100000:2.0:1789115466.058974:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:2.0:1789115466.058987:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+12:9887:x1876023288288384:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1789115466.059015:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115466.059057:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520e00/0xa47abda6516d330c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3ad1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115466.059176:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1789115466.059354:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520e00/0xa47abda6516d330c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ad1 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.059370:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01ae200) 00010000:00010000:2.0:1789115466.059373:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789115466.059377:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520e00/0xa47abda6516d330c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ad1 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.059436:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1520e00, rc 0) 00000100:00100000:2.0:1789115466.059512:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+13:9887:x1876023288288384:12345-192.168.203.31@tcp:101:rm.0 Request processed in 528us (745us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1789115466.059520:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:1.0:1789115466.065243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115466.065341:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288288512 00000100:00100000:0.0:1789115466.065351:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288288512 00000100:00100000:0.0:1789115466.065416:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1789115466.065427:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+13:9887:x1876023288288512:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:1.0:1789115466.071122:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+13:9887:x1876023288288512:12345-192.168.203.31@tcp:37:rm.0 Request processed in 5687us (5882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115466.071140:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:3.0:1789115466.075885:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115466.076099:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288288768 00000100:00100000:2.0:1789115466.076109:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288288768 00000100:00100000:2.0:1789115466.076223:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1789115466.076234:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd8a4d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+13:9887:x1876023288288768:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:2.0:1789115466.076555:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd8a4d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+14:9887:x1876023288288768:12345-192.168.203.31@tcp:35:rm.0 Request processed in 322us (679us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789115466.076564:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1789115466.081812:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115466.082166:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288289024 00000100:00100000:0.0:1789115466.082176:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288289024 00000100:00100000:0.0:1789115466.082498:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1789115466.082510:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+14:9887:x1876023288289024:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:0.0:1789115466.082534:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115466.082553:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d331a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3ad8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.082676:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f000/0xa47abda6516d3321 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.082703:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f000/0xa47abda6516d3321 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.082714:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f000/0xa47abda6516d3321 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115466.082726:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1789115466.082852:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d331a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ad8 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.082872:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f000/0xa47abda6516d3321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ad8 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.082880:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dfcf2157b00) 00010000:00010000:0.0:1789115466.082883:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789115466.082886:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f000, rc 0) 00000100:00100000:0.0:1789115466.082960:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+16:9887:x1876023288289024:12345-192.168.203.31@tcp:101:rm.0 Request processed in 452us (1158us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789115466.082968:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:3.0:1789115466.085719:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115466.085863:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288289152 00000100:00100000:2.0:1789115466.085873:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288289152 00000100:00100000:2.0:1789115466.085931:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:2.0:1789115466.085951:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+16:9887:x1876023288289152:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:2.0:1789115466.086021:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1789115466.086096:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+16:9887:x1876023288289152:12345-192.168.203.31@tcp:41:rm.0 Request processed in 155us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115466.086104:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:1.0:1789115466.090714:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115466.090914:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288289280 00000100:00100000:3.0:1789115466.090948:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288289280 00000100:00100000:3.0:1789115466.091015:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1789115466.091025:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+16:9887:x1876023288289280:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1789115466.091045:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115466.091066:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d332f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3adf expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091130:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3336 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091145:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3336 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091157:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3336 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091172:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d333d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091179:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d333d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091185:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d333d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091295:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3344 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091304:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091310:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115466.091343:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789115466.091347:0:8213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789115466.091372:0:8213:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091409:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091418:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3336 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091423:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3336 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091429:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3336 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091434:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ebc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115466.091437:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3336 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091443:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3336 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091465:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dfcf2157b00) 00010000:00010000:3.0:1789115466.091468:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115466.091473:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3336 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091479:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3336 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091502:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d333d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091508:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d333d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091514:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d333d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091529:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115466.091533:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d333d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091539:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d333d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091547:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff8dfcf2157a00) 00010000:00010000:3.0:1789115466.091550:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115466.091552:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d333d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091558:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d333d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091589:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d332f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3adf expref: 18 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091604:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3adf expref: 17 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.091623:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dfcd044f200) 00010000:00010000:3.0:1789115466.091625:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789115466.091628:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ebe00, rc 0) 00000100:00100000:3.0:1789115466.091694:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+17:9887:x1876023288289280:12345-192.168.203.31@tcp:101:rm.0 Request processed in 670us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115466.091701:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1789115466.095612:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115466.095758:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288289536 00000100:00100000:2.0:1789115466.095768:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288289536 00000100:00100000:2.0:1789115466.095823:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1789115466.095834:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+17:9887:x1876023288289536:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1789115466.095888:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789115466.095915:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3344 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3adf expref: 17 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.095950:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d32f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ac3 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.095962:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dfcd044f200) 00010000:00010000:2.0:1789115466.095979:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3305 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aca expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.095988:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dfcf2157b00) 00010000:00010000:2.0:1789115466.095992:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789115466.096013:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520e00/0xa47abda6516d334b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.096026:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520e00/0xa47abda6516d334b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.096037:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520e00/0xa47abda6516d334b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.096067:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d3352 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.096075:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d3352 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.096082:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d3352 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.096204:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521000/0xa47abda6516d3359 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.096212:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521000/0xa47abda6516d3359 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.096218:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521000/0xa47abda6516d3359 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789115466.097326:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789115466.097339:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 283309955772ns, next at 284309953251ns, rc = 0 00010000:00010000:2.0:1789115466.097852:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3360 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.097868:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3360 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.097879:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3360 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.097887:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3360 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.097904:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3360 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.097910:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3360 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.098023:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789115466.098049:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521000/0xa47abda6516d3359 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.098056:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521000/0xa47abda6516d3359 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.098063:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521000/0xa47abda6516d3359 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.098068:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115466.098073:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521000/0xa47abda6516d3359 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.098080:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521000/0xa47abda6516d3359 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.098102:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dfcc5118d00) 00010000:00010000:2.0:1789115466.098105:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789115466.098110:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521000/0xa47abda6516d3359 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.098117:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521000/0xa47abda6516d3359 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.098136:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520e00/0xa47abda6516d334b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.098148:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520e00/0xa47abda6516d334b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.098153:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520e00/0xa47abda6516d334b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.098158:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1520e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115466.098161:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520e00/0xa47abda6516d334b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.098167:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520e00/0xa47abda6516d334b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.098176:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dfcf2157b00) 00010000:00010000:2.0:1789115466.098178:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115466.098181:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520e00/0xa47abda6516d334b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115466.098186:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520e00/0xa47abda6516d334b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789115466.098197:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d2a0766d reply state 000000006d8013cd transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d3352 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115466.098205:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789115466.098298:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+16:9887:x1876023288289536:12345-192.168.203.31@tcp:36:rm.0 Request processed in 2463us (2693us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789115466.098307:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1789115466.102698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:0.0:1789115466.103106:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d3352 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.103119:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d3352 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.103127:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d3352 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.103133:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115466.103153:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d3352 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.103162:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d3352 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.103178:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff8dfcc5118b00) 00010000:00010000:0.0:1789115466.103182:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115466.103187:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d3352 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.103193:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d3352 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115466.103295:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288289792 00000100:00100000:2.0:1789115466.103306:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288289792 00000100:00100000:2.0:1789115466.103358:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:2.0:1789115466.103368:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+15:9887:x1876023288289792:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:2.0:1789115466.104053:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+16:9887:x1876023288289792:12345-192.168.203.31@tcp:35:rm.0 Request processed in 684us (1363us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789115466.104063:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1789115466.107372:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115466.107512:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288290048 00000100:00100000:0.0:1789115466.107596:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288290048 00000100:00100000:0.0:1789115466.107660:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:0.0:1789115466.107670:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+16:9887:x1876023288290048:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:1.0:1789115466.107914:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115466.107924:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3360 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115466.107935:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacde00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115466.107939:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3360 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115466.107949:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3360 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115466.107964:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dfcc5118d00) 00010000:00010000:1.0:1789115466.107967:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789115466.107972:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3360 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115466.107997:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3360 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115466.108017:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115466.108019:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115466.108020:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115466.108343:0:8213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789115466.108364:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f000/0xa47abda6516d3321 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ad8 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.108407:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d32bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ab5 expref: 15 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.108419:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dfcf2157b00) 00010000:00010000:0.0:1789115466.108434:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3280 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aa7 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.108444:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01ae200) 00010000:00010000:0.0:1789115466.108475:0:8213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115466.108499:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d3367 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.108511:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d3367 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.108529:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d3367 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.108542:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d336e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.108550:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d336e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.108556:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d336e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.108845:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d3375 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.108854:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d3375 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.108861:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d3375 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115466.109563:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1789115466.109580:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d3375 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.109587:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d3375 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.109601:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d3375 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.109607:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ee00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115466.109611:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d3375 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.109618:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d3375 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.109629:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:0.0:1789115466.109632:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789115466.109636:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d3375 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.109642:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d3375 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.109662:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d3367 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.109669:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d3367 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.109674:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d3367 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.109679:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115466.109682:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d3367 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.109697:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d3367 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.109705:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:0.0:1789115466.109707:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115466.109710:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d3367 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115466.109715:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e200/0xa47abda6516d3367 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789115466.109728:0:8213:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bfd07fd7 reply state 000000004396ed76 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d336e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115466.109737:0:8213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789115466.109828:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+15:9887:x1876023288290048:12345-192.168.203.31@tcp:36:rm.0 Request processed in 2157us (2462us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789115466.109837:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00010000:00010000:1.0:1789115466.116001:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d336e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115466.116019:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d336e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115466.116036:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d336e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115466.116043:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115466.116048:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d336e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115466.116055:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d336e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115466.116077:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115466.116080:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115466.116085:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d336e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115466.116092:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d336e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115466.470974:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115467.238766:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115467.238808:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115467.238852:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115467.238882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115467.238965:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288290304 00000100:00100000:0.0:1789115467.238977:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288290304 00000100:00100000:0.0:1789115467.239056:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288290560 00000100:00100000:0.0:1789115467.239060:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288290560 00000100:00100000:0.0:1789115467.239089:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:0.0:1789115467.239100:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+14:2351:x1876023288290304:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115467.239257:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+14:2351:x1876023288290304:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 158us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115467.239266:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:0.0:1789115467.239287:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:0.0:1789115467.239369:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288290560:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115467.239442:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288290560:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 74us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115467.239460:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:0.0:1789115467.239488:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288290176 00000100:00100000:0.0:1789115467.239492:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288290176 00000100:00100000:0.0:1789115467.239524:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 277 00000100:00100000:0.0:1789115467.239531:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2351:x1876023288290176:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115467.239557:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2351:x1876023288290176:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115467.239563:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 277 00000100:00080000:3.0:1789115467.239778:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115467.239852:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288290432 00000100:00100000:2.0:1789115467.239857:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288290432 00000100:00100000:2.0:1789115467.239914:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:2.0:1789115467.239924:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+5:2351:x1876023288290432:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115467.239966:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+5:2351:x1876023288290432:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 45us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115467.239973:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00080000:3.0:1789115467.240054:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789115467.427753:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789115467.427783:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308248832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789115467.427883:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115467.427966:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308248832 00000100:00100000:2.0:1789115467.427977:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308248832 00000100:00100000:2.0:1789115467.428050:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789115467.428060:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308248832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789115467.428111:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115467.428163:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308248832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115467.428170:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789115467.428193:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789115467.428227:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcedabc000 x1876023308248832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115467.428269:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308248832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789115467.495001:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115468.451749:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc2d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308249088:0@lo:400:kworker.0 00000100:00100000:1.0:1789115468.451822:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115468.451825:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308249344:0@lo:400:kworker.0 00000100:00100000:3.0:1789115468.451859:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115468.451875:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308249600:0@lo:400:kworker.0 00000100:00100000:3.0:1789115468.451886:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789115468.451891:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308248960:0@lo:400:kworker.0 00000100:00100000:1.0:1789115468.451898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115468.451964:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308249344 00000100:00100000:2.0:1789115468.451972:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308249344 00000100:00100000:2.0:1789115468.452012:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308249600 00000100:00100000:2.0:1789115468.452016:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308249600 00000100:00100000:2.0:1789115468.452043:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789115468.452051:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308249344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115468.453620:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789115468.453635:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc2d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308249216:0@lo:400:kworker.0 00000100:00100000:3.0:1789115468.453652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115468.453686:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876023308249472:0@lo:400:kworker.0 00000100:00100000:1.0:1789115468.453686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115468.453847:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115468.453897:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308249088 00000100:00100000:3.0:1789115468.453904:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308249088 00000100:00100000:0.0:1789115468.453905:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789115468.453919:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308249600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115468.453955:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308249216 00000100:00100000:3.0:1789115468.453960:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308249216 00000100:00100000:0.0:1789115468.453977:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308249600:12345-0@lo:400:kworker.0 Request processed in 62us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115468.453979:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308249472 00000100:00100000:3.0:1789115468.453983:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308249472 00000100:00100000:0.0:1789115468.453990:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789115468.454008:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789115468.454017:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308249088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115468.454021:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789115468.454032:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308249216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115468.454062:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308249216:12345-0@lo:400:kworker.0 Request processed in 33us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115468.454067:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789115468.454078:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789115468.454083:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876023308249472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115468.454108:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876023308249472:12345-0@lo:400:kworker.0 Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115468.454119:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789115468.454136:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308249088:12345-0@lo:400:kworker.0 Request processed in 118us (2312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115468.454144:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789115468.454159:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876023308249472:0@lo:400:kworker.0 00000100:00100000:0.0:1789115468.454206:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308248960 00000100:00100000:0.0:1789115468.454210:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308248960 00000100:00100000:0.0:1789115468.454233:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789115468.454239:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3307:x1876023308248960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115468.454270:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3307:x1876023308248960:12345-0@lo:400:kworker.0 Request processed in 32us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115468.454275:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789115468.454304:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308248960:0@lo:400:kworker.0 00000100:00100000:2.0:1789115468.454675:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308249344:12345-0@lo:400:kworker.0 Request processed in 2623us (2813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115468.454749:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789115468.454772:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789115468.454777:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789115468.454838:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc89a3840 x1876023308249344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115468.454850:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308249344:0@lo:400:kworker.0 00000100:00100000:1.0:1789115468.455967:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc2d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308249216:0@lo:400:kworker.0 00000100:00100000:1.0:1789115468.455985:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc2d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308249088:0@lo:400:kworker.0 00010000:00080000:1.0:1789115468.456000:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc89a0b40 x1876023308249600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115468.456010:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308249600:0@lo:400:kworker.0 00010000:00010000:1.0:1789115468.517555:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789115468.963646:0:7935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 286176261219ns, next at 287176259327ns, rc = 0 00000100:00100000:1.0:1789115468.963727:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789115468.963746:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308249728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789115468.963811:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115468.963877:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308249728 00000100:00100000:2.0:1789115468.963884:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308249728 00000100:00100000:2.0:1789115468.963928:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789115468.963937:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308249728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789115468.963970:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115468.964021:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308249728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115468.964028:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789115468.964143:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc8852580 x1876023308249728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115468.964171:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308249728:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789115469.541353:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789115469.674652:0:12005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000020:00000080:2.0:1789115470.505055:0:12053:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe57fc3310 20000000:00000080:2.0:1789115470.505072:0:12053:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dfcf4f57000 uarg=0000000000000000 20000000:01000000:2.0:1789115470.505107:0:12053:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789115470.505114:0:12053:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789115470.505119:0:12053:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789115470.505871:0:12054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1789115470.506037:0:12053:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789115470.513842:0:12053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:2.0:1789115470.513933:0:12053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10256 00000040:00080000:2.0:1789115470.513975:0:12053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10480 10000000:01000000:2.0:1789115470.513993:0:12053:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789115470.514011:0:12053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115470.514029:0:12053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcedac7c00/0xa47abda6516d3225 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d321e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115470.514037:0:12053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcc0031400/0xa47abda6516d3233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d322c expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115470.514043:0:12053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcc0031800/0xa47abda6516d3241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d323a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115470.514053:0:12053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d3248 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a92 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115470.514060:0:12053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcedac7e00/0xa47abda6516d324f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a99 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115470.514067:0:12053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115470.514103:0:12053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcedac7e00/0xa47abda6516d324f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a99 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115470.514117:0:12053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfcedac7e00/0xa47abda6516d324f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a99 expref: 12 pid: 5843 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115470.514130:0:12053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabe1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12053:1876023308249856:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789115470.514286:0:12053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d3248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a92 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115470.514294:0:12053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d3248 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a92 expref: 12 pid: 5846 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115470.514302:0:12053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabe940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12053:1876023308249984:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789115470.514329:0:12053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcc0031800/0xa47abda6516d3241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d323a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115470.514336:0:12053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcc0031800/0xa47abda6516d3241 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d323a expref: 18 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115470.514344:0:12053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12053:1876023308250112:0@lo:104: 00000100:00100000:2.0:1789115470.514379:0:12053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789115470.514457:0:12053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcc0031400/0xa47abda6516d3233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d322c expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115470.514469:0:12053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcc0031400/0xa47abda6516d3233 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d322c expref: 18 pid: 5844 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115470.514477:0:12053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12053:1876023308250240:0@lo:104: 00000100:00100000:2.0:1789115470.514496:0:12053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789115470.514513:0:12053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcedac7c00/0xa47abda6516d3225 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d321e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115470.514520:0:12053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dfcedac7c00/0xa47abda6516d3225 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d321e expref: 18 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115470.514529:0:12053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc087c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12053:1876023308250368:0@lo:104: 00000100:00100000:2.0:1789115470.514555:0:12053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115470.514569:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308250112 00000100:00100000:2.0:1789115470.514574:0:12053:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfbc1c54180 going to sleep for 11 seconds 00000100:00100000:1.0:1789115470.514578:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308250112 00000100:00100000:1.0:1789115470.514617:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308250240 00000100:00100000:1.0:1789115470.514621:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308250240 00000100:00100000:1.0:1789115470.514632:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308250368 00000100:00100000:1.0:1789115470.514641:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308250368 00000100:00100000:1.0:1789115470.514660:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789115470.514669:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+5:12053:x1876023308250112:12345-0@lo:104: 00010000:00010000:1.0:1789115470.514681:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3241 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.514744:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789115470.514750:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+5:12053:x1876023308250112:12345-0@lo:104: Request processed in 83us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115470.514757:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789115470.514782:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789115470.514788:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+4:12053:x1876023308250240:12345-0@lo:104: 00010000:00010000:1.0:1789115470.514795:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3233 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.514830:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789115470.514835:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+4:12053:x1876023308250240:12345-0@lo:104: Request processed in 48us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115470.514841:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789115470.514856:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1789115470.514859:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789115470.514864:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc0861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+3:12053:x1876023308250368:12345-0@lo:104: 00010000:00010000:0.0:1789115470.514867:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3241 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.514873:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3225 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115470.514878:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc0030000 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:0.0:1789115470.514885:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d3241 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115470.514893:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d3241 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789115470.514910:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d3241 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.514914:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:01000000:0.0:1789115470.514916:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789115470.514922:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc0861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d846835-79f9-4361-81d5-b56fc2e9378a+3:12053:x1876023308250368:12345-0@lo:104: Request processed in 58us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115470.514930:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1789115470.514948:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3241 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115470.514955:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115470.514958:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789115470.514965:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3233 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.514974:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1520400 already unused, calling callback (ffffffffc1d25c20) 00010000:00010000:0.0:1789115470.514975:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3241 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115470.514978:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d3233 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115470.514988:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc0030000/0xa47abda6516d323a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3241 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.514992:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d3233 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789115470.515002:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d3233 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115470.515006:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1789115470.515009:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789115470.515011:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d3225 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115470.515019:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521800 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:0.0:1789115470.515022:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d3225 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115470.515028:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d3225 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.515031:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3233 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789115470.515039:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d3225 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.515041:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1789115470.515049:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789115470.515053:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3233 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.515064:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d322c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3233 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.515075:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115470.515078:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115470.515079:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3225 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.515080:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115470.515088:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789115470.515089:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115470.515107:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3225 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115470.515110:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8851a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308250752:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789115470.515121:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521800/0xa47abda6516d321e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d3225 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115470.515137:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115470.515140:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115470.515142:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115470.515147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115470.515165:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308250496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789115470.515191:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308250752 00000100:00100000:1.0:1789115470.515196:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308250752 00000100:00100000:0.0:1789115470.515201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789115470.515218:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcedac7c00/0xa47abda6516d3225 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d321e expref: 19 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115470.515228:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789115470.515237:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308250624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789115470.515241:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308250496 00000100:00100000:1.0:1789115470.515245:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308250496 00010000:00010000:1.0:1789115470.515258:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcc0031800/0xa47abda6516d3241 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d323a expref: 20 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115470.515267:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115470.515328:0:12053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12053:1876023308250112:0@lo:104: 00000100:00100000:2.0:1789115470.515336:0:12053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12053:1876023308250240:0@lo:104: 00000100:00100000:2.0:1789115470.515343:0:12053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc087c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12053:1876023308250368:0@lo:104: 00000100:00100000:1.0:1789115470.520766:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308250624 00000100:00100000:1.0:1789115470.520778:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308250624 00010000:00010000:1.0:1789115470.520815:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcc0031400/0xa47abda6516d3233 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d322c expref: 21 pid: 5844 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115470.520850:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789115470.520859:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff911e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+21:3305:x1876023308250752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789115470.520873:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115470.520879:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcedac7c00/0xa47abda6516d3225 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d321e expref: 21 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.520890:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcedac7c00/0xa47abda6516d3225 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d321e expref: 21 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.520911:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcedac7c00/0xa47abda6516d3225 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d321e expref: 21 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.520926:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115470.520979:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789115470.520991:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8852940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+20:3307:x1876023308250496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789115470.521002:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789115470.521005:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff911e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+20:3305:x1876023308250752:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (5857us total) trans 0 rc 0/0 00010000:00010000:3.0:1789115470.521010:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcc0031800/0xa47abda6516d3241 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d323a expref: 20 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115470.521022:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1789115470.521028:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcc0031800/0xa47abda6516d3241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d323a expref: 20 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.521044:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc0031800/0xa47abda6516d3241 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d323a expref: 20 pid: 5846 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.521057:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115470.521062:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789115470.521069:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8852580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+18:3307:x1876023308250624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789115470.521078:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115470.521084:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcc0031400/0xa47abda6516d3233 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d322c expref: 18 pid: 5844 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115470.521092:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8852940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:3307:x1876023308250496:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (5890us total) trans 0 rc 0/0 00010000:00010000:1.0:1789115470.521096:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcc0031400/0xa47abda6516d3233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d322c expref: 18 pid: 5844 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115470.521105:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1789115470.521112:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc0031400/0xa47abda6516d3233 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d322c expref: 18 pid: 5844 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115470.521123:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115470.521149:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8852580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d846835-79f9-4361-81d5-b56fc2e9378a+16:3307:x1876023308250624:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (5885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115470.521157:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789115470.521188:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8851a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308250752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789115470.521530:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308250624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789115470.521541:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308250496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789115470.522321:0:12053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabe1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12053:1876023308249856:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115470.522333:0:12053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabe940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12053:1876023308249984:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789115470.522365:0:12053:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115470.524170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115470.524246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115470.524348:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288290688 00000100:00100000:3.0:1789115470.524356:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288290688 00010000:00010000:3.0:1789115470.524418:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcedac7e00/0xa47abda6516d324f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a99 expref: 13 pid: 5843 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115470.524475:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288290816 00000100:00100000:3.0:1789115470.524479:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288290816 00010000:00010000:3.0:1789115470.524492:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d3248 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a92 expref: 14 pid: 5846 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115470.524514:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1789115470.524523:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc087c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+14:2352:x1876023288290688:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115470.524537:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115470.524542:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcedac7e00/0xa47abda6516d324f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a99 expref: 14 pid: 5843 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524554:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcedac7e00/0xa47abda6516d324f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a99 expref: 14 pid: 5843 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524572:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcedac7e00/0xa47abda6516d324f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a99 expref: 14 pid: 5843 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524586:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115470.524637:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc087c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2352:x1876023288290688:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 114us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115470.524644:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1789115470.524676:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1789115470.524683:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:2353:x1876023288290816:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115470.524692:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115470.524696:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d3248 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a92 expref: 12 pid: 5846 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524716:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d3248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a92 expref: 12 pid: 5846 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524732:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d3248 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a92 expref: 12 pid: 5846 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524743:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524751:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524766:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524773:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524780:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524787:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524793:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacd400 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115470.524797:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524805:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524838:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115470.524848:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115470.524867:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:2353:x1876023288290816:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 185us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115470.524873:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00010000:00010000:0.0:1789115470.525115:0:12053:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115470.525125:0:12053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115470.525132:0:12053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcedacd400/0xa47abda6516d337c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115470.564594:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789115471.071776:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789115471.071807:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1789115471.071829:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789115471.072074:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308250880:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789115471.072135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115471.072410:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308250880 00000100:00100000:0.0:1789115471.072417:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308250880 00000100:00100000:0.0:1789115471.072580:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789115471.072589:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308250880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789115471.072611:0:6699:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1789115471.072643:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa3bc49, atime: 0x6aa3bc49, ctime: 0x6aa3bc49, blocks: 0x1 00010000:00010000:0.0:1789115471.072651:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c24b685/0xa47abda6516d3383 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.072666:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=288s v=(0 0) 00010000:00010000:0.0:1789115471.072670:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115471.072677:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c24b685/0xa47abda6516d3383 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.072693:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c24b685/0xa47abda6516d3383 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.072704:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c24b685/0xa47abda6516d3383 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.072712:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c24b685/0xa47abda6516d3383 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.072726:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789115471.073514:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876023308250880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 923us (1375us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789115471.073532:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1789115471.073587:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dfcc8850000/2, rc 0, transno 4294967300 00000100:00100000:0.0:1789115471.073594:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308250880:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789115471.073672:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115471.073680:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c24b685/0xa47abda6516d3383 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115471.073689:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ee00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115471.073693:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c24b685/0xa47abda6516d3383 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115471.073702:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c24b685/0xa47abda6516d3383 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115471.073723:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c24b685/0xa47abda6516d3383 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115471.073738:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c24b685/0xa47abda6516d3383 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115471.073758:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115471.073759:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115471.073761:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789115471.079361:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789115471.587612:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789115471.587688:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789115471.587693:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcff92b000 from 10 10000000:01000000:2.0:1789115471.587700:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789115471.587749:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115471.587760:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115471.587771:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115471.587798:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc087c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308251008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789115471.587871:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115471.587944:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfbc1c54a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789115471.588113:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308251008 00000100:00100000:0.0:1789115471.588120:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308251008 00000100:00100000:0.0:1789115471.588175:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789115471.588184:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+16:5848:x1876023308251008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789115471.588198:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115471.588212:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d3391 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d338a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.588235:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d3391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d338a expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.588245:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d3391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d338a expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.588254:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e200, rc 0) 00000100:00100000:0.0:1789115471.588303:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308251008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115471.588310:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789115471.592042:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc087c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308251008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789115471.592073:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3391 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115471.592084:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3391 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115471.592165:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc087c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308251136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115471.592222:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115471.592272:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfbc1c54a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789115471.593257:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308251136 00000100:00100000:0.0:1789115471.593267:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308251136 00000100:00100000:0.0:1789115471.593327:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789115471.593337:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308251136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789115471.593703:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308251136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 366us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115471.593719:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789115471.593945:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc087c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308251136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115471.593991:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc087c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308251264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115471.594041:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115471.594082:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfbc1c54a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789115471.594148:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308251264 00000100:00100000:1.0:1789115471.594153:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308251264 00000100:00100000:1.0:1789115471.594185:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789115471.594193:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308251264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115471.594368:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308251264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115471.594374:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789115471.596133:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc087c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308251264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115471.597085:0:12068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc087c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:12068:1876023308251392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115471.597161:0:12068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115471.597243:0:12068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfbc1c546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789115471.600744:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308251392 00000100:00100000:3.0:1789115471.600759:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308251392 00000100:00100000:3.0:1789115471.600831:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789115471.600842:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:12068:x1876023308251392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789115471.601131:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:12068:x1876023308251392:12345-0@lo:502:llog_process_th.0 Request processed in 290us (3968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115471.601139:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789115471.602109:0:12068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc087c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:12068:1876023308251392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789115471.602147:0:12068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789115471.602158:0:12068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115471.602160:0:12068:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789115471.602167:0:12068:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dfcff92b000 00000020:00000080:2.0:1789115471.602170:0:12068:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789115471.602269:0:12068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc087c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:12068:1876023308251520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115471.602331:0:12068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115471.602360:0:12068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfbc1c546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789115471.603468:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308251520 00000100:00100000:1.0:1789115471.603478:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308251520 00000100:00100000:1.0:1789115471.603527:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789115471.603536:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:12068:x1876023308251520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115471.603823:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+17:12068:x1876023308251520:12345-0@lo:502:llog_process_th.0 Request processed in 286us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115471.603832:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789115471.604727:0:12068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc087c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:12068:1876023308251520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789115471.604765:0:12068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115471.604773:0:12068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115471.604775:0:12068:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789115471.604780:0:12068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789115471.605310:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:1.0:1789115471.605330:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789115471.605342:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3391 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115471.605354:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3391 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115471.605375:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789115471.605378:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcd8ba8800 from 10 10000000:01000000:1.0:1789115471.605424:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789115471.605461:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115471.605469:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115471.605478:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115471.605499:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308251648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789115471.605556:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115471.608354:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308251648 00000100:00100000:0.0:1789115471.608367:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308251648 00000100:00100000:0.0:1789115471.609102:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789115471.609113:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+17:5848:x1876023308251648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789115471.609684:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115471.609706:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d339f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d3398 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.609737:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d339f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d3398 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.609747:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d339f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d3398 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.609755:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f000, rc 0) 00000100:00100000:0.0:1789115471.609827:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308251648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 716us (4271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115471.609835:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789115471.611112:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfcff4180 going to sleep for 11 seconds 00000100:00100000:1.0:1789115471.611153:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308251648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115471.611175:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d339f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115471.611187:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d339f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115471.611271:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308251776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115471.611325:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115471.611353:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfcff4180 going to sleep for 11 seconds 00000100:00100000:2.0:1789115471.612087:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308251776 00000100:00100000:2.0:1789115471.612095:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308251776 00000100:00100000:2.0:1789115471.612139:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789115471.612148:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308251776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115471.612454:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308251776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115471.612461:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789115471.614085:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308251776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115471.614148:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308251904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115471.614221:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115471.614266:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfcff4180 going to sleep for 11 seconds 00000100:00100000:2.0:1789115471.614549:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308251904 00000100:00100000:2.0:1789115471.614555:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308251904 00000100:00100000:2.0:1789115471.614608:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789115471.614619:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0689050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308251904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115471.614816:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0689050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308251904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115471.614824:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789115471.617313:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308251904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115471.623646:0:12070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:12070:1876023308252032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115471.623737:0:12070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115471.623801:0:12070:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfcff4240 going to sleep for 11 seconds 00000100:00100000:0.0:1789115471.624064:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308252032 00000100:00100000:0.0:1789115471.624071:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308252032 00000100:00100000:0.0:1789115471.624124:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789115471.624134:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:12070:x1876023308252032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789115471.624464:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:12070:x1876023308252032:12345-0@lo:502:llog_process_th.0 Request processed in 330us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115471.624472:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789115471.631747:0:12070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:12070:1876023308252032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789115471.631803:0:12070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789115471.631814:0:12070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115471.631817:0:12070:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789115471.631824:0:12070:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dfcd8ba8800 00000020:00000080:3.0:1789115471.631827:0:12070:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789115471.631951:0:12070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a1a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:12070:1876023308252160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789115471.632036:0:12070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115471.632090:0:12070:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd06b5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789115471.632134:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308252160 00000100:00100000:3.0:1789115471.632140:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308252160 00000100:00100000:3.0:1789115471.632184:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789115471.632194:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:12070:x1876023308252160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789115471.632468:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+18:12070:x1876023308252160:12345-0@lo:502:llog_process_th.0 Request processed in 275us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115471.632477:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789115471.632524:0:12070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a1a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:12070:1876023308252160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789115471.632544:0:12070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789115471.632548:0:12070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115471.632550:0:12070:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789115471.632554:0:12070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000040:00080000:3.0:1789115471.637115:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:0.0:1789115471.638013:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:0.0:1789115471.638058:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789115471.638071:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d339f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.638083:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d339f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789115471.638095:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789115471.638098:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcc65aa800 from 10 10000000:01000000:0.0:1789115471.638101:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789115471.638141:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.638149:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.638160:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115471.638185:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8852940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308252288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789115471.638254:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115471.638290:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc5d77780 going to sleep for 11 seconds 00000100:00100000:1.0:1789115471.640470:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308252288 00000100:00100000:1.0:1789115471.640484:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308252288 00000100:00100000:1.0:1789115471.640538:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789115471.640549:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+18:5848:x1876023308252288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115471.640565:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115471.640594:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d33ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d33a6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115471.640622:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d33ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d33a6 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115471.640634:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d33ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d33a6 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115471.640644:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6200, rc 0) 00000100:00100000:1.0:1789115471.640740:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308252288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (2484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115471.640747:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789115471.640803:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8852940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308252288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789115471.640825:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.640835:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115471.643955:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308252416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115471.644026:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115471.644065:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfcff4480 going to sleep for 11 seconds 00000100:00100000:0.0:1789115471.651673:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308252416 00000100:00100000:0.0:1789115471.651695:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308252416 00000100:00100000:0.0:1789115471.651759:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789115471.651770:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce068a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308252416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789115471.652075:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce068a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308252416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (8048us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115471.652084:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789115471.652449:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308252416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115471.652499:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308252544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115471.652546:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115471.652580:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfcff4480 going to sleep for 11 seconds 00000100:00100000:3.0:1789115471.653643:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308252544 00000100:00100000:3.0:1789115471.653655:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308252544 00000100:00100000:3.0:1789115471.653698:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789115471.653706:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce0688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308252544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115471.653922:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce0688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:5848:x1876023308252544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115471.653930:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789115471.654121:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d846835-79f9-4361-81d5-b56fc2e9378a:5848:1876023308252544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789115471.657777:0:12074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8852940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:12074:1876023308252672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789115471.657851:0:12074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115471.657892:0:12074:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc5d77a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789115471.657941:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308252672 00000100:00100000:3.0:1789115471.657947:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308252672 00000100:00100000:3.0:1789115471.657990:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789115471.657998:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:12074:x1876023308252672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789115471.658201:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:12074:x1876023308252672:12345-0@lo:502:llog_process_th.0 Request processed in 203us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115471.658209:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789115471.658293:0:12074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8852940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:12074:1876023308252672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789115471.658318:0:12074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115471.658327:0:12074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115471.658329:0:12074:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789115471.658338:0:12074:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dfcc65aa800 00000020:00000080:1.0:1789115471.658341:0:12074:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789115471.658434:0:12074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:12074:1876023308252800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115471.658466:0:12074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115471.658478:0:12074:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfcff4480 going to sleep for 11 seconds 00000100:00100000:0.0:1789115471.658536:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308252800 00000100:00100000:0.0:1789115471.658540:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308252800 00000100:00100000:0.0:1789115471.658565:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789115471.658572:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:12074:x1876023308252800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789115471.658717:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:12074:x1876023308252800:12345-0@lo:502:llog_process_th.0 Request processed in 145us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115471.658724:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789115471.658870:0:12074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d846835-79f9-4361-81d5-b56fc2e9378a:12074:1876023308252800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789115471.658891:0:12074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115471.658896:0:12074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115471.658897:0:12074:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789115471.658902:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789115471.659131:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:0.0:1789115471.659151:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789115471.659161:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.659172:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115471.723080:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115471.723151:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288290944 00000100:00100000:0.0:1789115471.723159:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288290944 00000100:00100000:0.0:1789115471.723210:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 294 00000100:00100000:0.0:1789115471.723219:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:5593:x1876023288290944:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789115471.723246:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115471.723262:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d33b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3ae6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.723289:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d33b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ae6 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.723301:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d33b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ae6 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115471.723309:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e600, rc 0) 00000100:00100000:0.0:1789115471.723366:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288290944:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 148us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115471.723373:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 294 00000100:00100000:3.0:1789115471.736555:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115471.736797:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288291072 00000100:00100000:1.0:1789115471.736807:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288291072 00000100:00100000:1.0:1789115471.736866:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 295 00000100:00100000:1.0:1789115471.736875:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288291072:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115471.737229:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288291072:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 354us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115471.737248:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 295 00000100:00100000:2.0:1789115471.740164:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115471.740620:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288291200 00000100:00100000:3.0:1789115471.740630:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288291200 00000100:00100000:3.0:1789115471.740687:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 296 00000100:00100000:3.0:1789115471.740697:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288291200:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115471.740946:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288291200:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 250us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115471.740954:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 296 00000100:00100000:3.0:1789115471.748708:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115471.749242:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288291328 00000100:00100000:1.0:1789115471.749252:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288291328 00000100:00100000:1.0:1789115471.749303:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 297 00000100:00100000:1.0:1789115471.749310:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:10157:x1876023288291328:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789115471.749635:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:10157:x1876023288291328:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 322us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115471.749644:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 297 00000100:00100000:1.0:1789115471.759370:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115471.763604:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288291456 00000100:00100000:0.0:1789115471.763620:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288291456 00000100:00100000:0.0:1789115471.763697:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 298 00000100:00100000:0.0:1789115471.763708:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:10157:x1876023288291456:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789115471.763973:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:10157:x1876023288291456:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 266us (4612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115471.763984:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 298 00000100:00100000:2.0:1789115471.774233:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115471.774430:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288291584 00000100:00100000:3.0:1789115471.774440:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288291584 00000100:00100000:3.0:1789115471.774494:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 299 00000100:00100000:3.0:1789115471.774503:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:5593:x1876023288291584:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115471.774520:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115471.774537:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d33bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3aed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115471.774564:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d33bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aed expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115471.774575:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d33bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aed expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115471.774601:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eaa00, rc 0) 00000100:00100000:3.0:1789115471.774665:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288291584:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 162us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115471.774674:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 299 00000100:00100000:3.0:1789115471.779074:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115471.779715:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288291712 00000100:00100000:1.0:1789115471.779725:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288291712 00000100:00100000:1.0:1789115471.779788:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 300 00000100:00100000:1.0:1789115471.779798:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288291712:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115471.781455:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288291712:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 1647us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115471.781468:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 300 00000100:00100000:2.0:1789115471.792354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115471.792903:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288291840 00000100:00100000:3.0:1789115471.792913:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288291840 00000100:00100000:3.0:1789115471.792965:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 301 00000100:00100000:3.0:1789115471.792976:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288291840:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115471.793211:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:5593:x1876023288291840:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 236us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115471.793219:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 301 00000100:00100000:2.0:1789115471.799431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115471.799722:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288291968 00000100:00100000:1.0:1789115471.799731:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288291968 00000100:00100000:1.0:1789115471.799788:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 302 00000100:00100000:1.0:1789115471.799798:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:10160:x1876023288291968:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789115471.800082:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:10160:x1876023288291968:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 283us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115471.800091:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 302 00000100:00100000:1.0:1789115471.805951:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115471.809442:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288292096 00000100:00100000:0.0:1789115471.809457:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288292096 00000100:00100000:0.0:1789115471.809534:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 303 00000100:00100000:0.0:1789115471.809545:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:10160:x1876023288292096:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789115471.809832:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:10160:x1876023288292096:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 288us (3889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115471.809848:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 303 00000100:00100000:2.0:1789115472.360846:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115472.360893:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115472.360951:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115472.360997:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115472.361006:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288292352 00000100:00100000:0.0:1789115472.361017:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288292352 00000100:00100000:2.0:1789115472.361026:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288292480 00000100:00100000:2.0:1789115472.361033:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288292480 00000100:00100000:0.0:1789115472.361074:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288292608 00000100:00100000:0.0:1789115472.361078:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288292608 00000100:00100000:2.0:1789115472.361083:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1789115472.361096:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288292480:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115472.361110:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:0.0:1789115472.361119:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc087c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288292352:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115472.361166:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288292480:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 74us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115472.361178:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc087c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288292352:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 59us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115472.361188:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:0.0:1789115472.361206:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:0.0:1789115472.361213:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288292608:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115472.361237:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288292608:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 24us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115472.361243:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:1.0:1789115472.362690:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288292224 00000100:00100000:1.0:1789115472.362713:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288292224 00000100:00100000:1.0:1789115472.362765:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 304 00000100:00100000:1.0:1789115472.362775:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2353:x1876023288292224:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115472.362834:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2353:x1876023288292224:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 62us (1883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115472.362841:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 304 00000100:00100000:2.0:1789115472.365192:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00080000:3.0:1789115472.365770:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789115472.365777:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115472.547800:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789115472.547825:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308252928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789115472.547898:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115472.548376:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308252928 00000100:00100000:0.0:1789115472.548398:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308252928 00000100:00100000:0.0:1789115472.549052:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789115472.549064:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308252928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789115472.549111:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115472.549178:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308252928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115472.549186:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1789115472.549228:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc8852580 x1876023308252928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115472.549263:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308252928:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789115472.552660:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789115472.612694:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789115472.677087:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789115473.575357:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876023308253312:0@lo:400:kworker.0 00000100:00100000:0.0:1789115473.575485:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115473.575548:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789115473.575554:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308253184:0@lo:400:kworker.0 00000100:00100000:0.0:1789115473.575576:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115473.575604:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcdaa73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308253696:0@lo:400:kworker.0 00000100:00100000:0.0:1789115473.575631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115473.575665:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308253696 00000100:00100000:0.0:1789115473.575672:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308253696 00000100:00100000:0.0:1789115473.575726:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789115473.575734:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8852940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876023308253696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115473.575782:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8852940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876023308253696:12345-0@lo:400:kworker.0 Request processed in 49us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115473.575789:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789115473.575813:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308253312 00000100:00100000:0.0:1789115473.575816:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308253312 00000100:00100000:0.0:1789115473.575851:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308253184 00000100:00100000:0.0:1789115473.575853:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308253184 00000100:00100000:0.0:1789115473.575874:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789115473.575892:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8852580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876023308253312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115473.575923:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8852580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876023308253312:12345-0@lo:400:kworker.0 Request processed in 43us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115473.575929:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789115473.575939:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789115473.575961:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8851a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308253184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115473.575989:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8851a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308253184:12345-0@lo:400:kworker.0 Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115473.575995:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1789115473.576017:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789115473.576023:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789115473.576052:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308253056:0@lo:400:kworker.0 00000100:00100000:0.0:1789115473.576082:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115473.576102:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876023308253568:0@lo:400:kworker.0 00000100:00100000:0.0:1789115473.576123:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115473.576140:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789115473.576145:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308253440:0@lo:400:kworker.0 00000100:00100000:0.0:1789115473.576168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115473.576192:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308253440 00000100:00100000:0.0:1789115473.576196:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308253440 00000100:00100000:0.0:1789115473.576218:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789115473.576224:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308253440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115473.576255:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308253440:12345-0@lo:400:kworker.0 Request processed in 31us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115473.576261:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789115473.576275:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308253568 00000100:00100000:0.0:1789115473.576278:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308253568 00000100:00100000:0.0:1789115473.576303:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789115473.576309:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876023308253568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115473.576336:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876023308253568:12345-0@lo:400:kworker.0 Request processed in 28us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115473.576351:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1789115473.576366:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115473.576431:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308253184:0@lo:400:kworker.0 00000100:00100000:0.0:1789115473.576445:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcdaa73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308253696:0@lo:400:kworker.0 00000100:00100000:0.0:1789115473.576454:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876023308253312:0@lo:400:kworker.0 00010000:00080000:0.0:1789115473.576487:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcd35f7c00 x1876023308253440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115473.576497:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308253440:0@lo:400:kworker.0 00000100:00100000:0.0:1789115473.576506:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876023308253568:0@lo:400:kworker.0 00000100:00100000:1.0:1789115473.577432:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308253056 00000100:00100000:1.0:1789115473.577441:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308253056 00000100:00100000:1.0:1789115473.577492:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789115473.577500:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3308:x1876023308253056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115473.577567:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3308:x1876023308253056:12345-0@lo:400:kworker.0 Request processed in 68us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115473.577574:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789115473.578525:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308253056:0@lo:400:kworker.0 00010000:00010000:1.0:1789115473.636685:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115474.083982:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789115474.084006:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308253824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115474.084075:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115474.085070:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308253824 00000100:00100000:0.0:1789115474.085078:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308253824 00000100:00100000:0.0:1789115474.085131:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789115474.085140:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876023308253824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115474.085193:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115474.085263:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876023308253824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115474.085272:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789115474.085417:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308253824:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789115474.659557:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115475.684072:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789115476.194523:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1789115476.708282:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115477.477427:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115477.477549:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288292736 00000100:00100000:0.0:1789115477.477558:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288292736 00000100:00100000:0.0:1789115477.477610:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 306 00000100:00100000:0.0:1789115477.477626:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288292736:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115477.477710:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288292736:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 92us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115477.477717:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 306 00000100:00100000:1.0:1789115477.484668:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115477.484708:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115477.484745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115477.484845:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288292864 00000100:00100000:2.0:1789115477.484855:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288292864 00000100:00100000:2.0:1789115477.484914:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288293120 00000100:00100000:2.0:1789115477.484917:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288293120 00000100:00100000:2.0:1789115477.484940:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:2.0:1789115477.484950:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+5:2351:x1876023288292864:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115477.485020:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+5:2351:x1876023288292864:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 71us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115477.485027:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:2.0:1789115477.485044:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:2.0:1789115477.485058:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288293120:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115477.485084:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288293120:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115477.485090:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00080000:1.0:1789115477.485255:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115477.485413:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288292992 00000100:00100000:3.0:1789115477.485417:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288292992 00000100:00100000:3.0:1789115477.485468:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:3.0:1789115477.485476:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2351:x1876023288292992:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115477.485525:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2351:x1876023288292992:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 50us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115477.485530:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00080000:1.0:1789115477.485622:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789115477.667990:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308253952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789115477.668061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115477.668536:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308253952 00000100:00100000:1.0:1789115477.668544:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308253952 00000100:00100000:1.0:1789115477.668606:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789115477.668616:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308253952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789115477.668647:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789115477.669087:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789115477.672122:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308253952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3500us (4052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115477.672136:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1789115477.672246:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff911e00 x1876023308253952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115477.672270:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308253952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789115477.737756:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115478.691755:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308254208:0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.691837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115478.691907:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308254720:0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.691943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115478.691976:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789115478.691982:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308254336:0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.692003:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115478.692047:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308254720 00000100:00100000:2.0:1789115478.692055:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308254720 00000100:00100000:2.0:1789115478.692110:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789115478.692118:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff970b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308254720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.692170:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff970b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308254720:12345-0@lo:400:kworker.0 Request processed in 52us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115478.692177:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789115478.692198:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308254208 00000100:00100000:2.0:1789115478.692213:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308254208 00000100:00100000:2.0:1789115478.692236:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308254336 00000100:00100000:2.0:1789115478.692238:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308254336 00000100:00100000:2.0:1789115478.692255:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789115478.692261:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308254208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.692306:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308254208:12345-0@lo:400:kworker.0 Request processed in 44us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115478.692312:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789115478.692325:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789115478.692331:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308254336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.692415:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308254336:12345-0@lo:400:kworker.0 Request processed in 84us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115478.692421:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1789115478.692441:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789115478.692445:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789115478.692456:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308254464:0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.692482:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115478.692503:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789115478.692508:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308254080:0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.692532:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115478.692554:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876023308254592:0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.692575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115478.692599:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308254080 00000100:00100000:2.0:1789115478.692603:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308254080 00000100:00100000:2.0:1789115478.692626:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789115478.692632:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3307:x1876023308254080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.692662:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3307:x1876023308254080:12345-0@lo:400:kworker.0 Request processed in 30us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115478.692675:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789115478.692701:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308254464 00000100:00100000:2.0:1789115478.692704:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308254464 00000100:00100000:2.0:1789115478.692725:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789115478.692731:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff971680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308254464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.692760:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff971680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308254464:12345-0@lo:400:kworker.0 Request processed in 29us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115478.692765:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789115478.692781:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308254592 00000100:00100000:2.0:1789115478.692784:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308254592 00000100:00100000:2.0:1789115478.692806:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789115478.692812:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8824f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876023308254592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.692838:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8824f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876023308254592:12345-0@lo:400:kworker.0 Request processed in 26us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115478.692843:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1789115478.692854:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115478.692879:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308254336:0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.692887:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308254208:0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.692895:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1789115478.692900:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dfcc8850000, transno 4294967300 00000100:00100000:2.0:1789115478.692908:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308254720:0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.692932:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308254080:0@lo:400:kworker.0 00000100:00100000:2.0:1789115478.692940:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876023308254592:0@lo:400:kworker.0 00010000:00080000:2.0:1789115478.692950:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc89a3c00 x1876023308254464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115478.692966:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308254464:0@lo:400:kworker.0 00010000:00010000:2.0:1789115478.759867:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115479.203800:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308254848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789115479.203885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115479.204025:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308254848 00000100:00100000:0.0:1789115479.204033:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308254848 00000100:00100000:0.0:1789115479.204089:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789115479.204098:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308254848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115479.204133:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115479.204187:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308254848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115479.204195:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789115479.204281:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308254848:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789115479.779580:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115480.803534:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115481.828523:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115482.599427:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115482.599467:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115482.599497:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115482.599522:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115482.599607:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288293376 00000100:00100000:2.0:1789115482.599617:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288293376 00000100:00100000:2.0:1789115482.599700:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288293632 00000100:00100000:2.0:1789115482.599704:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288293632 00000100:00100000:2.0:1789115482.599727:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:2.0:1789115482.599737:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+5:2351:x1876023288293376:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115482.599819:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+5:2351:x1876023288293376:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 84us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115482.599827:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:2.0:1789115482.599842:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:2.0:1789115482.599849:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288293632:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115482.599873:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288293632:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115482.599879:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:2.0:1789115482.599898:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288293504 00000100:00100000:2.0:1789115482.599901:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288293504 00000100:00100000:2.0:1789115482.599947:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:2.0:1789115482.599954:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+5:2351:x1876023288293504:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115482.599995:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+5:2351:x1876023288293504:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 41us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115482.600001:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00080000:1.0:1789115482.600241:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789115482.600246:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115482.600800:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288293248 00000100:00100000:0.0:1789115482.600807:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288293248 00000100:00100000:0.0:1789115482.600848:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 308 00000100:00100000:0.0:1789115482.600856:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2351:x1876023288293248:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115482.600909:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2351:x1876023288293248:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 48us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115482.600923:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 308 00000100:00100000:1.0:1789115482.788529:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789115482.788550:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308254976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789115482.788723:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115482.788784:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308254976 00000100:00100000:1.0:1789115482.788791:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308254976 00000100:00100000:1.0:1789115482.788834:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789115482.788841:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308254976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789115482.788870:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115482.788904:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308254976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115482.788911:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1789115482.789032:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789115482.789197:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcff911e00 x1876023308254976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115482.789214:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308254976:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789115482.854005:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789115482.916163:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789115483.813085:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115483.813419:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308255232:0@lo:400:kworker.0 00000100:00100000:3.0:1789115483.813483:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115483.813552:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789115483.813558:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308255360:0@lo:400:kworker.0 00000100:00100000:3.0:1789115483.813584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115483.813631:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308255232 00000100:00100000:3.0:1789115483.813638:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308255232 00000100:00100000:3.0:1789115483.813676:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308255360 00000100:00100000:3.0:1789115483.813679:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308255360 00000100:00100000:3.0:1789115483.813707:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789115483.813716:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308255232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115483.813766:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308255232:12345-0@lo:400:kworker.0 Request processed in 51us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115483.813773:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789115483.813790:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789115483.813796:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308255360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115483.813837:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308255360:12345-0@lo:400:kworker.0 Request processed in 41us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115483.813843:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1789115483.813861:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115483.813888:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308255360:0@lo:400:kworker.0 00000100:00100000:3.0:1789115483.813898:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308255232:0@lo:400:kworker.0 00000100:00100000:2.0:1789115483.819585:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308255488:0@lo:400:kworker.0 00000100:00100000:2.0:1789115483.819660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115483.819720:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308255104:0@lo:400:kworker.0 00000100:00100000:2.0:1789115483.819748:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115483.820279:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308255488 00000100:00100000:3.0:1789115483.820287:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308255488 00000100:00100000:3.0:1789115483.820349:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789115483.820371:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8826d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308255488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115483.820458:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8826d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308255488:12345-0@lo:400:kworker.0 Request processed in 88us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115483.820465:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789115483.820924:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876023308255616:0@lo:400:kworker.0 00000100:00100000:0.0:1789115483.820958:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115483.820994:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308255616 00000100:00100000:0.0:1789115483.820998:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308255616 00000100:00100000:0.0:1789115483.821035:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789115483.821043:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876023308255616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115483.821099:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876023308255616:12345-0@lo:400:kworker.0 Request processed in 56us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115483.821106:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1789115483.821128:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115483.821154:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876023308255616:0@lo:400:kworker.0 00000100:00100000:0.0:1789115483.821180:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789115483.821188:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308255744:0@lo:400:kworker.0 00000100:00100000:0.0:1789115483.821212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115483.822966:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308255744 00000100:00100000:2.0:1789115483.822977:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308255744 00000100:00100000:2.0:1789115483.823050:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789115483.823059:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308255744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115483.823145:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308255744:12345-0@lo:400:kworker.0 Request processed in 88us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115483.823152:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789115483.823193:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308255744:0@lo:400:kworker.0 00010000:00080000:2.0:1789115483.823232:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcd35f4b40 x1876023308255488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115483.823241:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308255488:0@lo:400:kworker.0 00000100:00080000:0.0:1789115483.824441:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789115483.825181:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308255104 00000100:00100000:1.0:1789115483.825191:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308255104 00000100:00100000:1.0:1789115483.825308:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789115483.825317:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3307:x1876023308255104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115483.825430:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3307:x1876023308255104:12345-0@lo:400:kworker.0 Request processed in 114us (5680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115483.825437:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789115483.825543:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308255104:0@lo:400:kworker.0 00010000:00010000:0.0:1789115483.875586:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115484.324759:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789115484.324792:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308255872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115484.324863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115484.325005:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308255872 00000100:00100000:1.0:1789115484.325013:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308255872 00000100:00100000:1.0:1789115484.325062:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789115484.325071:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308255872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789115484.325140:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115484.325198:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308255872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115484.325205:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789115484.325755:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308255872:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789115484.899716:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115485.924062:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115486.947553:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115487.722613:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115487.722680:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115487.722884:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288293888 00000100:00100000:2.0:1789115487.722900:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288293888 00000100:00100000:2.0:1789115487.722978:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:2.0:1789115487.722998:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2350:x1876023288293888:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115487.723072:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2350:x1876023288293888:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 86us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115487.723091:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00080000:0.0:1789115487.723614:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115487.723958:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288293760 00000100:00100000:3.0:1789115487.723966:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288293760 00000100:00100000:3.0:1789115487.724018:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 310 00000100:00100000:3.0:1789115487.724027:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288293760:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115487.724094:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288293760:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 68us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115487.724102:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 310 00000100:00100000:1.0:1789115487.743464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115487.743516:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115487.743894:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288294016 00000100:00100000:3.0:1789115487.743904:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288294016 00000100:00100000:3.0:1789115487.743976:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:3.0:1789115487.743995:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2349:x1876023288294016:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:3.0:1789115487.744028:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d32f7 00000100:00080000:3.0:1789115487.744036:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8dfce07e6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789115487.744074:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1789115487.744696:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+2:2349:x1876023288294016:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 708us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115487.744705:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00010000:00010000:3.0:1789115487.744756:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115487.745058:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288294144 00000100:00100000:0.0:1789115487.745066:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288294144 00000100:00100000:0.0:1789115487.745113:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:0.0:1789115487.745122:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288294144:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115487.745189:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288294144:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 68us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115487.745196:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00080000:1.0:1789115487.746024:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789115487.746031:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789115487.907752:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789115487.907773:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308256000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789115487.907848:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115487.910286:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308256000 00000100:00100000:1.0:1789115487.910301:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308256000 00000100:00100000:1.0:1789115487.910524:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789115487.910535:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308256000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789115487.910581:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115487.910682:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308256000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (2833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115487.910689:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789115487.911029:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcd35f52c0 x1876023308256000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115487.911049:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308256000:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789115487.919024:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789115487.972739:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115488.931672:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308256256:0@lo:400:kworker.0 00000100:00100000:3.0:1789115488.931744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115488.931842:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308256256 00000100:00100000:3.0:1789115488.931849:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308256256 00000100:00100000:3.0:1789115488.931895:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789115488.931904:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308256256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115488.931968:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308256256:12345-0@lo:400:kworker.0 Request processed in 64us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115488.931975:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789115488.932018:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308256256:0@lo:400:kworker.0 00000100:00100000:3.0:1789115488.932055:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876023308256384:0@lo:400:kworker.0 00000100:00100000:3.0:1789115488.932079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115488.932134:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789115488.932140:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308256768:0@lo:400:kworker.0 00000100:00100000:3.0:1789115488.932166:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115488.932973:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308256512:0@lo:400:kworker.0 00000100:00100000:1.0:1789115488.933071:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115488.933125:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789115488.933132:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308256128:0@lo:400:kworker.0 00000100:00100000:1.0:1789115488.933165:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115488.933199:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876023308256640:0@lo:400:kworker.0 00000100:00100000:1.0:1789115488.933225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115488.933273:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308256128 00000100:00100000:1.0:1789115488.933280:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308256128 00000100:00100000:1.0:1789115488.933338:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789115488.933347:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3307:x1876023308256128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115488.933437:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3307:x1876023308256128:12345-0@lo:400:kworker.0 Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115488.933446:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789115488.933493:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308256384 00000100:00100000:1.0:1789115488.933502:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308256640 00000100:00100000:0.0:1789115488.933506:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308256384 00000100:00100000:1.0:1789115488.933509:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308256640 00000100:00100000:1.0:1789115488.933564:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789115488.933574:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876023308256640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115488.933610:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876023308256640:12345-0@lo:400:kworker.0 Request processed in 39us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115488.933616:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1789115488.933640:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115488.933678:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308256128:0@lo:400:kworker.0 00000100:00100000:0.0:1789115488.933684:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789115488.933702:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876023308256384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115488.933703:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876023308256640:0@lo:400:kworker.0 00000100:00100000:2.0:1789115488.933905:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308256768 00000100:00100000:2.0:1789115488.933911:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308256768 00000100:00100000:2.0:1789115488.933948:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308256512 00000100:00100000:2.0:1789115488.933952:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308256512 00000100:00100000:2.0:1789115488.933971:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789115488.933978:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308256768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115488.934056:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789115488.934065:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308256512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115488.934111:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308256512:12345-0@lo:400:kworker.0 Request processed in 48us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115488.934116:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789115488.934159:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789115488.934349:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876023308256384:12345-0@lo:400:kworker.0 Request processed in 653us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115488.934357:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:0.0:1789115488.934431:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc89a03c0 x1876023308256512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115488.934444:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308256512:0@lo:400:kworker.0 00000100:00100000:2.0:1789115488.940006:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308256768:12345-0@lo:400:kworker.0 Request processed in 6019us (7828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115488.940021:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789115488.941176:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876023308256384:0@lo:400:kworker.0 00000100:00100000:1.0:1789115488.941234:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308256768:0@lo:400:kworker.0 00010000:00010000:0.0:1789115488.995555:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115489.445848:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308256896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789115489.445915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115489.446325:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308256896 00000100:00100000:0.0:1789115489.446340:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308256896 00000100:00100000:0.0:1789115489.446416:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789115489.446426:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308256896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115489.446461:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115489.446512:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308256896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115489.446518:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789115489.451603:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308256896:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789115490.020771:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115491.043669:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789115491.594731:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6dbf7574-92fb-4b89-af78-41319f924699 00000020:00000080:1.0:1789115491.594740:0:7644:0:(genops.c:885:class_export_put()) final put ffff8dfce07e5800/6dbf7574-92fb-4b89-af78-41319f924699 00000020:00000080:1.0:1789115491.594769:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfce07e5800/6dbf7574-92fb-4b89-af78-41319f924699 for lustre-OST0001 00000020:00000080:1.0:1789115491.594813:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfce07e6800 for lustre-OST0001 00010000:00010000:1.0:1789115492.077866:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789115492.138272:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789115492.839226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115492.840151:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288294272 00000100:00100000:2.0:1789115492.840162:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288294272 00000100:00100000:2.0:1789115492.840232:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 312 00000100:00100000:2.0:1789115492.840242:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2352:x1876023288294272:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115492.840335:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2352:x1876023288294272:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 94us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115492.840343:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 312 00000100:00100000:2.0:1789115492.842024:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115492.842104:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115492.842244:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288294400 00000100:00100000:3.0:1789115492.842245:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288294528 00000100:00100000:3.0:1789115492.842254:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288294528 00000100:00100000:0.0:1789115492.842254:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288294400 00000100:00100000:0.0:1789115492.842331:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:0.0:1789115492.842341:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff911e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2352:x1876023288294400:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115492.842428:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff911e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2352:x1876023288294400:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 87us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115492.842435:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:3.0:1789115492.845143:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:3.0:1789115492.845159:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd3423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288294528:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115492.845256:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd3423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288294528:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 102us (3150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115492.845265:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00080000:2.0:1789115492.849297:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115493.038267:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789115493.038491:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308257024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789115493.038574:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115493.038645:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308257024 00000100:00100000:0.0:1789115493.038653:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308257024 00000100:00100000:0.0:1789115493.038709:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789115493.038720:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308257024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789115493.038755:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115493.038799:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308257024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115493.038806:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1789115493.038826:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789115493.038853:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcd35f52c0 x1876023308257024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115493.038872:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308257024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789115493.096213:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115494.051905:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308257152:0@lo:400:kworker.0 00000100:00100000:1.0:1789115494.051981:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115494.052082:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308257152 00000100:00100000:2.0:1789115494.052421:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308257152 00000100:00100000:2.0:1789115494.052466:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789115494.052558:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3308:x1876023308257152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115494.056879:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308257536:0@lo:400:kworker.0 00000100:00100000:3.0:1789115494.056950:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115494.056991:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115494.056998:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876023308257664:0@lo:400:kworker.0 00000100:00100000:3.0:1789115494.057038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115494.057074:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308257280:0@lo:400:kworker.0 00000100:00100000:3.0:1789115494.057109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115494.057126:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308257792:0@lo:400:kworker.0 00000100:00100000:3.0:1789115494.057147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115494.057187:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789115494.057193:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308257408:0@lo:400:kworker.0 00000100:00100000:3.0:1789115494.057214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115494.057244:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308257536 00000100:00100000:3.0:1789115494.057250:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308257536 00000100:00100000:3.0:1789115494.057470:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308257792 00000100:00100000:3.0:1789115494.057474:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308257792 00000100:00100000:3.0:1789115494.057520:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789115494.057529:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308257536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115494.057586:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308257536:12345-0@lo:400:kworker.0 Request processed in 58us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115494.057594:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789115494.057611:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789115494.057617:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5184b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308257792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115494.057647:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5184b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308257792:12345-0@lo:400:kworker.0 Request processed in 30us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115494.057652:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789115494.057670:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308257664 00000100:00100000:3.0:1789115494.057673:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308257664 00000100:00100000:3.0:1789115494.057696:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308257280 00000100:00100000:3.0:1789115494.057698:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308257280 00000100:00100000:3.0:1789115494.057708:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308257408 00000100:00100000:3.0:1789115494.057710:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308257408 00000100:00100000:3.0:1789115494.057722:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789115494.057728:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5187840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876023308257664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115494.057769:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5187840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876023308257664:12345-0@lo:400:kworker.0 Request processed in 41us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115494.057775:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789115494.057786:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789115494.057792:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf51852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308257280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115494.057816:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf51852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308257280:12345-0@lo:400:kworker.0 Request processed in 25us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115494.057821:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789115494.057831:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789115494.057836:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5186d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308257408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115494.057872:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5186d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308257408:12345-0@lo:400:kworker.0 Request processed in 36us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115494.057877:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1789115494.057906:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789115494.057911:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789115494.057946:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308257408:0@lo:400:kworker.0 00000100:00100000:3.0:1789115494.057956:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308257280:0@lo:400:kworker.0 00000100:00100000:3.0:1789115494.057963:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308257792:0@lo:400:kworker.0 00000100:00100000:3.0:1789115494.057991:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876023308257664:0@lo:400:kworker.0 00010000:00080000:3.0:1789115494.058002:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc89a1680 x1876023308257536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789115510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115494.058012:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308257536:0@lo:400:kworker.0 00000100:00100000:2.0:1789115494.060620:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3308:x1876023308257152:12345-0@lo:400:kworker.0 Request processed in 8136us (8629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115494.060635:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789115494.060861:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308257152:0@lo:400:kworker.0 00010000:00010000:1.0:1789115494.118617:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115494.563634:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789115494.563657:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308257920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789115494.563724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115494.563888:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308257920 00000100:00100000:0.0:1789115494.563896:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308257920 00000100:00100000:0.0:1789115494.563948:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789115494.563958:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308257920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115494.563991:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115494.564034:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308257920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115494.564041:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789115494.565505:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308257920:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789115494.795331:0:12236:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:31:32 (1789115492) 00010000:00010000:1.0:1789115495.140826:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115496.165522:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115496.476952:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115496.477184:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288294656 00000100:00100000:0.0:1789115496.477194:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288294656 00000100:00100000:0.0:1789115496.477310:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:0.0:1789115496.477322:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5185e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:10429:x1876023288294656:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115496.477352:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115496.477434:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d33c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3af4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115496.481993:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d33c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115496.482014:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d33c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115496.482028:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d33c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115496.482264:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789115496.482269:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115496.482369:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d33c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115496.482432:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d33c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3af4 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115496.482450:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d33c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3af4 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115496.482459:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:0.0:1789115496.482462:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789115496.482465:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28ea00, rc 0) 00000100:00100000:0.0:1789115496.482542:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5185e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:10429:x1876023288294656:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 5223us (5598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115496.482552:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00080000:3.0:1789115496.483533:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115496.492032:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115496.492984:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288294784 00000100:00100000:3.0:1789115496.492995:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288294784 00000100:00100000:3.0:1789115496.493074:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:3.0:1789115496.493084:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc331680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:10430:x1876023288294784:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789115496.493103:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115496.493126:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d33d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3afb expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115496.493187:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d33d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115496.493213:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d33d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115496.493225:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d33d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115496.493241:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d33de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115496.493257:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d33de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115496.493265:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d33de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115496.493708:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d33e5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115496.493984:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d33e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115496.493992:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d33e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115496.494780:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1789115496.494788:0:8213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789115496.494876:0:8213:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d33e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.494891:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d33d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.494898:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d33d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.494906:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d33d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.494913:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ebc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115496.494918:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d33d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.494926:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d33d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.494941:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:2.0:1789115496.494944:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115496.494948:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d33d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.494962:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d33d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.494977:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d33de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.494983:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d33de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.494989:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d33de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.494994:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115496.494997:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d33de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.495004:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d33de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.495025:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8dfcf2157c00) 00010000:00010000:2.0:1789115496.495028:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115496.495031:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d33de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.495037:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d33de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.495078:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d33d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3afb expref: 8 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.495093:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d33e5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3afb expref: 7 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115496.495108:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dfcf2157f00) 00010000:00010000:2.0:1789115496.495110:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789115496.495113:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eba00, rc 0) 00000100:00100000:2.0:1789115496.495202:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc331680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:10430:x1876023288294784:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 2117us (3177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115496.495211:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1789115496.499950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115496.500041:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288295040 00000100:00100000:1.0:1789115496.500051:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288295040 00000100:00100000:1.0:1789115496.500108:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1789115496.500117:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc332580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+7:10430:x1876023288295040:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789115496.500150:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115496.500170:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d33ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b02 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.500238:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d33f3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.500261:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d33f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.500272:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d33f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.500325:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d33fa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.500333:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d33fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.500339:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d33fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.500889:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7c00/0xa47abda6516d3401 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.500899:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7c00/0xa47abda6516d3401 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.500907:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7c00/0xa47abda6516d3401 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115496.500916:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1789115496.501107:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d33f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501114:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d33f3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501121:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d33f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501127:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115496.501132:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d33f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501139:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d33f3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501150:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dfcf2157f00) 00010000:00010000:1.0:1789115496.501153:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115496.501158:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d33f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501164:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d33f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501176:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d33fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501182:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d33fa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501188:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d33fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501203:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115496.501206:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d33fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501211:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d33fa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501219:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8dfcd01ae400) 00010000:00010000:1.0:1789115496.501222:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115496.501225:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d33fa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501231:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d33fa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501648:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d33ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b02 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501664:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7c00/0xa47abda6516d3401 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b02 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115496.501671:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:1.0:1789115496.501674:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115496.501676:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7c00, rc 0) 00000100:00100000:1.0:1789115496.501741:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc332580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+9:10430:x1876023288295040:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1624us (1800us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789115496.501750:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:3.0:1789115496.506201:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115496.506491:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288295168 00000100:00100000:0.0:1789115496.506501:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288295168 00000100:00100000:0.0:1789115496.506560:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1789115496.506571:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf51843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+9:10430:x1876023288295168:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789115496.506692:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf51843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+9:10430:x1876023288295168:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 113us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115496.506700:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000001:00080000:3.0:1789115496.707268:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:1.0:1789115497.192133:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789115497.269196:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789115497.961561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115497.961594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115497.961650:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115497.961872:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288295296 00000100:00100000:0.0:1789115497.961881:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288295296 00000100:00100000:0.0:1789115497.961939:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 314 00000100:00100000:0.0:1789115497.961959:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2353:x1876023288295296:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115497.962029:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2353:x1876023288295296:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 80us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115497.962038:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 314 00000100:00100000:3.0:1789115497.962260:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288295552 00000100:00100000:3.0:1789115497.962264:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288295552 00000100:00100000:3.0:1789115497.962343:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288295424 00000100:00100000:3.0:1789115497.962347:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288295424 00000100:00100000:3.0:1789115497.962372:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:3.0:1789115497.962405:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc330f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288295552:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115497.962449:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc330f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288295552:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 70us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115497.962456:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:3.0:1789115497.962470:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:3.0:1789115497.962477:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288295424:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115497.962502:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288295424:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115497.962509:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00080000:0.0:1789115497.962696:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115498.148783:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789115498.148805:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308258048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789115498.148870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115498.151842:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308258048 00000100:00100000:1.0:1789115498.151855:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308258048 00000100:00100000:1.0:1789115498.151931:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789115498.151942:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308258048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789115498.151977:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115498.152051:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308258048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (3180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115498.152059:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1789115498.152110:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcc603f0c0 x1876023308258048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115498.152128:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308258048:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789115498.152903:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789115498.211808:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115498.252899:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115498.253041:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288295680 00000100:00100000:1.0:1789115498.253050:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288295680 00000100:00100000:1.0:1789115498.253122:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:1.0:1789115498.253133:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:10472:x1876023288295680:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115498.253167:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115498.253195:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d340f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b09 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253273:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3416 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253287:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253305:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253320:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d341d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253327:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d341d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253334:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d341d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253584:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253592:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3416 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253599:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3416 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253606:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115498.253610:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3416 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253618:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3416 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253630:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:1.0:1789115498.253633:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115498.253637:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3416 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253648:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3416 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253660:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d341d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253665:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d341d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253670:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d341d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253674:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115498.253677:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d341d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253683:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d341d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253690:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8dfcd01ae100) 00010000:00010000:1.0:1789115498.253693:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115498.253696:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d341d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253701:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d341d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253730:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d340f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b09 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253750:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:1.0:1789115498.253752:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115498.253757:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d340f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b09 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.253766:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7000, rc 0) 00000100:00080000:0.0:1789115498.254056:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115498.254097:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:10472:x1876023288295680:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 964us (1205us total) trans 0 rc 301/301 00000100:00100000:1.0:1789115498.254105:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1789115498.260768:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115498.262561:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288295936 00000100:00100000:1.0:1789115498.262574:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288295936 00000100:00100000:1.0:1789115498.262667:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:1.0:1789115498.262677:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+8:10472:x1876023288295936:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:1.0:1789115498.262737:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115498.262761:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d33c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3af4 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.262778:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:1.0:1789115498.262787:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789115498.263070:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3424 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.263083:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3424 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.263092:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3424 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.263113:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d342b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.263121:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d342b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.263127:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d342b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115498.264166:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1789115498.264178:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3424 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.264186:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3424 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.264193:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3424 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.264198:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115498.264202:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3424 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.264210:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3424 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.264222:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01ae500) 00010000:00010000:1.0:1789115498.264225:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115498.264228:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3424 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.264256:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3424 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789115498.264272:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ee0bc80f reply state 000000000e75c3da transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d342b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115498.264280:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789115498.264407:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+9:10472:x1876023288295936:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 1702us (3617us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789115498.264416:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00010000:00010000:0.0:1789115498.268951:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d342b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.268969:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d342b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.268976:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d342b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.268983:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115498.268989:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d342b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.269004:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d342b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.269020:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8dfcd01ae700) 00010000:00010000:0.0:1789115498.269023:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115498.269028:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d342b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.269034:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d342b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115498.342799:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115498.342843:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288296064 00000100:00100000:3.0:1789115498.342857:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288296064 00000100:00100000:3.0:1789115498.342950:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1789115498.342960:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+8:10480:x1876023288296064:12345-192.168.203.31@tcp:101:lctl.0 00010000:00010000:3.0:1789115498.342994:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115498.343015:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d3432 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b10 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.343077:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d3439 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.343092:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d3439 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.343103:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d3439 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115498.343171:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789115498.343185:0:8213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789115498.343233:0:8213:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d3439 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.343269:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d3432 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b10 expref: 10 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.343284:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d3439 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b10 expref: 9 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.343292:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcf2157400) 00010000:00010000:3.0:1789115498.343295:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789115498.343298:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eae00, rc 0) 00000100:00100000:3.0:1789115498.343361:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+9:10480:x1876023288296064:12345-192.168.203.31@tcp:101:lctl.0 Request processed in 403us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115498.343369:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:2.0:1789115498.387731:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115498.387958:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288296192 00000100:00100000:0.0:1789115498.387967:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288296192 00000100:00100000:0.0:1789115498.388066:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:0.0:1789115498.388075:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+9:10486:x1876023288296192:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1789115498.388094:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115498.388116:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3440 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388183:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3447 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388197:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388209:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388222:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d344e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388253:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d344e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388261:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d344e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388374:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d3455 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388420:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d3455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388429:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d3455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115498.388472:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1789115498.388476:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115498.388513:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d3455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388525:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388532:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3447 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388539:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3447 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388554:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115498.388557:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3447 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388571:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3447 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388588:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcf2157400) 00010000:00010000:0.0:1789115498.388591:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115498.388596:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3447 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388602:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3447 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388615:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d344e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388622:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d344e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388628:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d344e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388633:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115498.388636:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d344e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388642:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d344e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388648:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8dfcd044f800) 00010000:00010000:0.0:1789115498.388651:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115498.388654:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d344e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388669:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d344e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388699:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3440 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b17 expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388712:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d3455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b17 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.388721:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:0.0:1789115498.388723:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789115498.388726:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f200, rc 0) 00000100:00100000:0.0:1789115498.388788:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+10:10486:x1876023288296192:12345-192.168.203.31@tcp:101:bash.0 Request processed in 714us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115498.388795:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:0.0:1789115498.391253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115498.391317:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288296448 00000100:00100000:1.0:1789115498.391326:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288296448 00000100:00100000:1.0:1789115498.391452:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1789115498.391462:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+10:10486:x1876023288296448:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1789115498.391479:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115498.391509:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d345c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b1e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.391623:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3463 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.391639:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3463 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.391650:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3463 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.391976:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d346a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.392002:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d346a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.392011:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d346a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789115498.393599:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789115498.393962:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3471 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.393985:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.393997:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.394031:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3463 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.394038:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3463 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.394045:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3463 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.394051:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115498.394054:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3463 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.394061:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3463 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.394081:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115498.394083:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115498.394089:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3463 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.394095:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3463 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789115498.394107:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c5b09b18 reply state 000000003a1762bd transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d346a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115498.394115:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789115498.394146:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d345c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b1e expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.394169:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3471 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b1e expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.394177:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae100) 00010000:00010000:1.0:1789115498.394180:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115498.394182:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6c00, rc 0) 00000100:00100000:1.0:1789115498.394429:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+13:10486:x1876023288296448:12345-192.168.203.31@tcp:101:bash.0 Request processed in 2968us (3288us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789115498.394438:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00010000:00010000:1.0:1789115498.399768:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d346a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.399786:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d346a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.399822:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d346a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.399828:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115498.399833:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d346a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.399975:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d346a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.399994:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcd01ae500) 00010000:00010000:1.0:1789115498.399997:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115498.400002:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d346a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.400008:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d346a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115498.402965:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115498.403267:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288296576 00000100:00100000:3.0:1789115498.403277:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288296576 00000100:00100000:3.0:1789115498.403324:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:3.0:1789115498.403331:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1876023288296576:12345-192.168.203.31@tcp:8:bash.0 00010000:00080000:3.0:1789115498.403362:0:6698:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:3.0:1789115498.403414:0:6698:0:(genops.c:1385:class_connect()) connect: client 6dbf7574-92fb-4b89-af78-41319f924699, cookie 0xa47abda6516d347f 00002000:00100000:3.0:1789115498.403426:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6dbf7574-92fb-4b89-af78-41319f924699/ffff8dfcc6040800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398e ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789115498.403437:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:3.0:1789115498.403679:0:6698:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789115498.404567:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8dfcc6044800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789115498.404693:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+6:2349:x1876023288296576:12345-192.168.203.31@tcp:8:bash.0 Request processed in 1353us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115498.404860:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:3.0:1789115498.413904:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115498.413980:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288296704 00000100:00100000:0.0:1789115498.413989:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288296704 00000100:00100000:0.0:1789115498.414060:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1789115498.414069:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5184f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:0:x1876023288296704:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1789115498.414087:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115498.414109:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3486 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b25 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789115498.414134:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115498.414163:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1789115498.414167:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115498.414176:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3486 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b25 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.414582:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3486 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b25 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.414597:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e400, rc 0) 00000100:00100000:0.0:1789115498.414648:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5184f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+7:0:x1876023288296704:12345-192.168.203.31@tcp:101:bash.0 Request processed in 580us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115498.414655:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00080000:3.0:1789115498.415027:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789115498.424401:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115498.424474:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288296832 00000100:00100000:0.0:1789115498.424484:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288296832 00000100:00100000:0.0:1789115498.424543:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1789115498.424552:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:10486:x1876023288296832:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1789115498.424570:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115498.424588:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b2c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.424618:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3486 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b25 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.424628:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115498.424632:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115498.424647:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.424694:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3486 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b25 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.425004:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3486 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b25 expref: 8 pid: 6697 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115498.425016:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc2d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6699:1876023308258176:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115498.425108:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd07940c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115498.430250:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc2d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6699:1876023308258176:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115498.430285:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.430305:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e000, rc 0) 00000100:00100000:0.0:1789115498.430365:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:10486:x1876023288296832:12345-192.168.203.31@tcp:101:bash.0 Request processed in 5814us (5995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115498.430375:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1789115498.431938:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115498.432017:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288296960 00000100:00100000:3.0:1789115498.432025:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288296960 00010000:00010000:3.0:1789115498.432058:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3486 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b25 expref: 8 pid: 6697 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115498.432086:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:3.0:1789115498.432092:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:2352:x1876023288296960:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115498.432105:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115498.432129:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3486 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b25 expref: 8 pid: 6697 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.432143:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3486 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b25 expref: 8 pid: 6697 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.432170:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3486 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b25 expref: 8 pid: 6697 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.432197:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115498.432208:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115498.432217:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.432350:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.432437:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115498.432451:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf5185a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1876023308258304:192.168.203.31@tcp:105: 00000100:00100000:3.0:1789115498.432581:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789115498.437044:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf5185a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1876023308258304:192.168.203.31@tcp:105: 00010000:00010000:3.0:1789115498.437070:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115498.437129:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2352:x1876023288296960:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 5035us (5196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115498.437141:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1789115498.440824:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115498.440913:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288297216 00000100:00100000:0.0:1789115498.440922:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288297216 00000100:00100000:0.0:1789115498.440980:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1789115498.440991:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+12:10486:x1876023288297216:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:1.0:1789115498.442014:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+13:10486:x1876023288297216:12345-192.168.203.31@tcp:35:bash.0 Request processed in 1018us (1295us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789115498.442025:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:2.0:1789115498.543477:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115498.547269:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288297472 00000100:00100000:1.0:1789115498.547284:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288297472 00000100:00100000:1.0:1789115498.547479:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:1.0:1789115498.547490:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+13:10497:x1876023288297472:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115498.547515:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115498.547535:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3494 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b33 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115498.547659:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1789115498.547775:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3494 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b33 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.547790:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcf2157400) 00010000:00010000:1.0:1789115498.547793:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789115498.547798:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3494 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b33 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.547822:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7000, rc 0) 00000100:00100000:1.0:1789115498.547894:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+14:10497:x1876023288297472:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 406us (4516us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1789115498.547901:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1789115498.553319:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115498.553410:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288297728 00000100:00100000:1.0:1789115498.553419:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288297728 00000100:00100000:1.0:1789115498.553683:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1789115498.553694:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+14:10497:x1876023288297728:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1789115498.554103:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+15:10497:x1876023288297728:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 409us (790us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789115498.554112:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1789115498.659914:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115498.660101:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288297856 00000100:00100000:2.0:1789115498.660110:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288297856 00000100:00100000:2.0:1789115498.660170:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:2.0:1789115498.660179:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5185a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+15:10503:x1876023288297856:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789115498.660451:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115498.660473:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d34a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b3a expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.660533:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d34a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.660557:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d34a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.660569:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d34a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115498.660625:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1789115498.660628:0:8213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789115498.660651:0:8213:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d34a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.660676:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d34a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b3a expref: 17 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.660693:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d34a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b3a expref: 16 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.660702:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:2.0:1789115498.660704:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789115498.660708:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacd400, rc 0) 00000100:00100000:2.0:1789115498.660756:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5185a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+16:10503:x1876023288297856:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 578us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115498.660765:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:0.0:1789115498.677882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115498.678954:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288298112 00000100:00100000:2.0:1789115498.678966:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288298112 00000100:00100000:2.0:1789115498.679076:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1789115498.679087:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+16:10503:x1876023288298112:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789115498.679108:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115498.679142:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d34b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.679254:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d34b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.679268:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d34b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.679280:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d34b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115498.679291:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789115498.679509:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d34b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b41 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.679527:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d34b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b41 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.679535:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae100) 00010000:00010000:2.0:1789115498.679537:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789115498.679541:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacc200, rc 0) 00000100:00100000:2.0:1789115498.679605:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+18:10503:x1876023288298112:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 521us (1731us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789115498.679612:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:0.0:1789115498.684249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115498.684430:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288298240 00000100:00100000:1.0:1789115498.684439:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288298240 00000100:00100000:1.0:1789115498.684492:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1789115498.684501:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaada580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+18:2351:x1876023288298240:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115498.684516:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115498.684547:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d34b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b41 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.684564:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae100) 00010000:00010000:1.0:1789115498.684569:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115498.684620:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaada580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+17:2351:x1876023288298240:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 120us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115498.684628:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:3.0:1789115498.686929:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115498.686981:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288298496 00000100:00100000:1.0:1789115498.686989:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288298496 00000100:00100000:1.0:1789115498.687140:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:1.0:1789115498.687150:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5186940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+17:10503:x1876023288298496:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115498.687173:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115498.687191:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d34c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b48 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.687290:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d34cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.687305:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d34cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.687316:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d34cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115498.687328:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789115498.687463:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d34c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b48 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.687496:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d34cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b48 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.687505:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae100) 00010000:00010000:1.0:1789115498.687508:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789115498.687511:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6a00, rc 0) 00000100:00100000:1.0:1789115498.687558:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5186940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+19:10503:x1876023288298496:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 409us (637us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789115498.687565:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:2.0:1789115498.692692:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115498.692907:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288298624 00000100:00100000:3.0:1789115498.692916:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288298624 00000100:00100000:3.0:1789115498.692959:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1789115498.692967:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2352:x1876023288298624:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:3.0:1789115498.693011:0:6885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000595a9ad3/0xa47abda6516d34da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.693031:0:6885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.693040:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115498.693044:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789115498.693062:0:6885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000595a9ad3/0xa47abda6516d34da lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.693092:0:6885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115498.693106:0:6885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 7 pid: 6699 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115498.693120:0:6885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf5184780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6885:1876023308258432:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115498.693199:0:6885:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789115498.696669:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115498.696767:0:6885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf5184780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6885:1876023308258432:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789115498.696792:0:6885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000595a9ad3/0xa47abda6516d34da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115498.697202:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288298752 00000100:00100000:0.0:1789115498.697210:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288298752 00002000:00100000:0.0:1789115498.697310:0:6702:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8dfcf4c24b40 x1876023288298752/t0(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:314/0 lens 504/0 e 0 to 0 dl 1789115509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789115498.697321:0:6702:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcf4c24b40 with x1876023288298752 ext(0->12) 00010000:00010000:0.0:1789115498.697329:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 8 pid: 6699 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.697344:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 8 pid: 6699 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789115498.697352:0:6702:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dfcf4c24b40 00000100:00100000:0.0:1789115498.697547:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1789115498.697557:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288298752:12345-192.168.203.31@tcp:4:lfs.0 00000001:00100000:1.0:1789115498.751114:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6dbf7574-92fb-4b89-af78-41319f924699 00000100:00100000:0.0:1789115498.753846:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6dbf7574-92fb-4b89-af78-41319f924699+9:2353:x1876023288298752:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 56278us (57173us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789115498.753865:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00002000:00100000:0.0:1789115498.753882:0:6702:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8dfcf4c24b40 x1876023288298752/t4294967299(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:314/0 lens 504/448 e 0 to 0 dl 1789115509 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789115498.753895:0:6702:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcf4c24b40 with x1876023288298752 ext(0->12) 00010000:00010000:0.0:1789115498.753908:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 9 pid: 6699 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.753933:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 9 pid: 6699 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789115498.753959:0:6702:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dfcf4c24b40 00000100:00100000:1.0:1789115498.760852:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115498.761063:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288298880 00000100:00100000:2.0:1789115498.761075:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288298880 00010000:00010000:2.0:1789115498.761128:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 9 pid: 6699 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115498.761204:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1789115498.761215:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+9:2353:x1876023288298880:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115498.761245:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789115498.761270:0:6713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789115498.761273:0:6713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789115497 00002000:00010000:2.0:1789115498.761275:0:6713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789115497 00002000:00010000:2.0:1789115498.761277:0:6713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789115497 00010000:00010000:2.0:1789115498.761285:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 9 pid: 6699 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.761300:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 9 pid: 6699 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.761345:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d348d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b2c expref: 9 pid: 6699 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.761367:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789115498.761372:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789115498.761379:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000595a9ad3/0xa47abda6516d34da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.761455:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000595a9ad3/0xa47abda6516d34da lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.761495:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115498.761687:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288298880:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 473us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115498.761696:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00010000:00010000:1.0:1789115498.762728:0:6885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000595a9ad3/0xa47abda6516d34da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.762743:0:6885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000595a9ad3/0xa47abda6516d34da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.762782:0:6885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000595a9ad3/0xa47abda6516d34da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.762791:0:6885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000595a9ad3/0xa47abda6516d34da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.762808:0:6885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000595a9ad3/0xa47abda6516d34da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.762833:0:6885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ebc00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115498.762837:0:6885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000595a9ad3/0xa47abda6516d34da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.762847:0:6885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000595a9ad3/0xa47abda6516d34da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.762865:0:6885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000595a9ad3/0xa47abda6516d34da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.762873:0:6885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000595a9ad3/0xa47abda6516d34da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115498.762964:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2352:x1876023288298624:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 69995us (70276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115498.762974:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1789115498.766904:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115498.766981:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288299136 00000100:00100000:2.0:1789115498.766990:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288299136 00000100:00100000:2.0:1789115498.767033:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:2.0:1789115498.767042:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+19:10503:x1876023288299136:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:2.0:1789115498.767097:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d34cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b48 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789115498.767372:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1789115498.767484:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1789115498.768066:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1789115498.768120:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.768136:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3471 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b1e expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.768146:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.768177:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3471 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b1e expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.768191:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3471 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b1e expref: 23 pid: 5852 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115498.768204:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4c26d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1876023308258560:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115498.768301:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd88c0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789115498.775659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115498.775743:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288299264 00000100:00100000:0.0:1789115498.775752:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288299264 00010000:00010000:0.0:1789115498.775791:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3471 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b1e expref: 24 pid: 5852 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115498.775840:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:0.0:1789115498.775848:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c25e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+24:2352:x1876023288299264:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115498.775862:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115498.775869:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3471 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b1e expref: 24 pid: 5852 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.775881:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3471 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b1e expref: 24 pid: 5852 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.775903:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae100) 00010000:00010000:0.0:1789115498.775908:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.775926:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.775934:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115498.775951:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115498.776002:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c25e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+24:2352:x1876023288299264:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 155us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115498.776021:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00010000:00010000:1.0:1789115498.779162:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3471 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b1e expref: 23 pid: 5852 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115498.779190:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4c26d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1876023308258560:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115498.779215:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.779224:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.779315:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789115498.779472:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1789115498.780480:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1789115498.780601:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603c780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876023308258688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789115498.780663:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115498.780775:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789115498.781374:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308258688 00000100:00100000:2.0:1789115498.781413:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308258688 00000100:00100000:2.0:1789115498.781517:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789115498.781528:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1876023308258688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789115498.781631:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1876023308258688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 105us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115498.781639:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789115498.781739:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603c780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876023308258688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789115498.782431:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1789115498.782499:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603c780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876023308258816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789115498.782536:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115498.783190:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115498.783228:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308258816 00000100:00100000:0.0:1789115498.783244:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308258816 00000100:00100000:0.0:1789115498.783278:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789115498.783286:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1876023308258816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789115498.783911:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1876023308258816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 623us (1371us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789115498.783929:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789115498.784099:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603c780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876023308258816:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789115498.784163:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1789115498.784205:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.784216:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.784224:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.784308:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacce00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115498.784315:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.784335:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.784351:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae100) 00010000:00010000:1.0:1789115498.784354:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789115498.784358:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.784365:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d34e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789115498.784994:0:5853:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789115498.785205:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789115498.785216:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315997833709ns, next at 316997831794ns, rc = 0 00000001:00080000:2.0:1789115498.785224:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789115498.785350:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae100) 00010000:00010000:2.0:1789115498.785353:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789115498.785361:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d34cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b48 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115498.785614:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+26:10503:x1876023288299136:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 18572us (18721us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789115498.785623:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000020:00080000:2.0:1789115498.785627:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789115498.790845:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115498.792645:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288299392 00000100:00100000:1.0:1789115498.792659:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288299392 00000100:00100000:1.0:1789115498.793086:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1789115498.793098:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+26:10503:x1876023288299392:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115498.793123:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115498.793144:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d34e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b4f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.793201:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d34e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b4f expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.793217:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d34e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b4f expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.793249:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115498.793252:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789115498.793256:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6c00, rc 0) 00000100:00100000:1.0:1789115498.793334:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+27:10503:x1876023288299392:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 239us (2497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115498.793342:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:0.0:1789115498.799609:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115498.799724:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288299648 00000100:00100000:1.0:1789115498.799733:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288299648 00000100:00100000:1.0:1789115498.799781:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:1.0:1789115498.799792:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd8a4c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+27:10503:x1876023288299648:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1789115498.800006:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd8a4c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+28:10503:x1876023288299648:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 215us (406us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789115498.800014:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1789115498.903304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115498.903424:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288299904 00000100:00100000:2.0:1789115498.903434:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288299904 00000100:00100000:2.0:1789115498.903500:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:2.0:1789115498.903512:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5184780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+28:10513:x1876023288299904:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789115498.903554:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115498.903589:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d34ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b56 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115498.903724:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789115498.903875:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d34ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b56 expref: 30 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.903891:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcf2157400) 00010000:00010000:2.0:1789115498.903895:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789115498.903901:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d34ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b56 expref: 30 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.903926:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedaccc00, rc 0) 00000100:00100000:2.0:1789115498.903990:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5184780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+29:10513:x1876023288299904:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 480us (697us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1789115498.903998:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:0.0:1789115498.910802:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115498.911109:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288300032 00000100:00100000:2.0:1789115498.911118:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288300032 00000100:00100000:2.0:1789115498.911179:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1789115498.911189:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaadbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+29:10513:x1876023288300032:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:2.0:1789115498.911279:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d34fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911295:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d34fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911306:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d34fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911333:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3504 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911341:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911347:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911474:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d350b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911483:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d350b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911489:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d350b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789115498.911529:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d350b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911541:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d34fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911548:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d34fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911555:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d34fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911561:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacda00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115498.911565:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d34fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911579:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d34fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911591:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:2.0:1789115498.911594:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115498.911599:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d34fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911606:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d34fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911617:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911623:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3504 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911629:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911634:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacde00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115498.911637:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911643:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911651:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcc5118500) 00010000:00010000:2.0:1789115498.911653:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115498.911656:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3504 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911673:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3504 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911688:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d350b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911694:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d350b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911699:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d350b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911704:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedaccc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115498.911707:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d350b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911723:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d350b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911731:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:2.0:1789115498.911733:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115498.911736:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d350b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.911742:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d350b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115498.911825:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaadbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+29:10513:x1876023288300032:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 637us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115498.911834:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1789115498.913853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115498.914002:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288300288 00000100:00100000:3.0:1789115498.914011:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288300288 00000100:00100000:3.0:1789115498.914056:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1789115498.914064:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+29:10513:x1876023288300288:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1789115498.914296:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+30:10513:x1876023288300288:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 232us (448us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789115498.914303:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1789115498.977145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115498.977529:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288300544 00000100:00100000:1.0:1789115498.977539:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288300544 00000100:00100000:1.0:1789115498.977600:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:1.0:1789115498.977611:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5186580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+30:10516:x1876023288300544:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115498.977635:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115498.977656:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3512 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b5d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.977894:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3519 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.977911:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3519 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.977924:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3519 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.977940:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3520 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.977955:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.977961:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978085:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978094:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978102:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115498.978112:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789115498.978202:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3519 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978210:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3519 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978216:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3519 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978222:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115498.978226:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3519 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978366:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3519 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978420:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115498.978423:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115498.978428:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3519 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978434:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3519 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978447:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978453:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3520 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978459:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3520 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978464:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115498.978467:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3520 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978474:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3520 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978482:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcd01ae500) 00010000:00010000:1.0:1789115498.978485:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115498.978488:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3520 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978494:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3520 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978552:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3512 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b5d expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978567:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b5d expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115498.978574:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115498.978576:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115498.978579:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6a00, rc 0) 00000100:00100000:1.0:1789115498.978648:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5186580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+32:10516:x1876023288300544:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1039us (1512us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1789115498.978657:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:0.0:1789115498.990343:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115498.991198:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288300672 00000100:00100000:2.0:1789115498.991209:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288300672 00000100:00100000:2.0:1789115498.991288:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1789115498.991297:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+32:10516:x1876023288300672:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1789115498.991364:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3535 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.991426:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.991439:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.991466:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.991473:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3535 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.991480:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.991486:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedaccc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115498.991491:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.991500:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3535 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.991512:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:2.0:1789115498.991515:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789115498.991519:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3535 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115498.991539:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3535 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115498.991620:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+32:10516:x1876023288300672:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 323us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115498.991628:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1789115498.994017:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115498.994122:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288300928 00000100:00100000:3.0:1789115498.994131:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288300928 00000100:00100000:3.0:1789115498.994193:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:3.0:1789115498.994202:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+32:10516:x1876023288300928:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1789115498.994463:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+33:10516:x1876023288300928:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 261us (455us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789115498.994471:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:3.0:1789115499.171988:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf5184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876023308259200:0@lo:400:kworker.0 00000100:00100000:3.0:1789115499.172061:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115499.172136:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789115499.172143:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf5185680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308259072:0@lo:400:kworker.0 00000100:00100000:3.0:1789115499.172165:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115499.172179:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf51870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308259584:0@lo:400:kworker.0 00000100:00100000:3.0:1789115499.172199:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115499.172360:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf5187c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308258944:0@lo:400:kworker.0 00000100:00100000:1.0:1789115499.172424:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115499.172445:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf5187480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876023308259456:0@lo:400:kworker.0 00000100:00100000:1.0:1789115499.172466:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115499.172481:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789115499.172485:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf51861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308259328:0@lo:400:kworker.0 00000100:00100000:1.0:1789115499.172501:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115499.172529:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308259584 00000100:00100000:1.0:1789115499.172535:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308259584 00000100:00100000:1.0:1789115499.172584:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308259328 00000100:00100000:1.0:1789115499.172588:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308259328 00000100:00100000:1.0:1789115499.172610:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789115499.172618:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308259584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115499.172670:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308259584:12345-0@lo:400:kworker.0 Request processed in 53us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115499.172695:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789115499.172711:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789115499.172717:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308259328:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789115499.172746:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789115499.172749:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308259328:12345-0@lo:400:kworker.0 Request processed in 33us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115499.172755:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789115499.172757:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308259200 00000100:00100000:0.0:1789115499.172761:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308259200 00000100:00100000:1.0:1789115499.172787:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf51861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308259328:0@lo:400:kworker.0 00000100:00100000:0.0:1789115499.172789:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308259072 00000100:00100000:0.0:1789115499.172791:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308259072 00000100:00100000:1.0:1789115499.172815:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf51870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308259584:0@lo:400:kworker.0 00000100:00100000:0.0:1789115499.172815:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308259456 00000100:00100000:0.0:1789115499.172817:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308259456 00000100:00100000:0.0:1789115499.172830:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789115499.172836:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876023308259200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115499.172875:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876023308259200:12345-0@lo:400:kworker.0 Request processed in 40us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115499.172922:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308258944 00000100:00100000:3.0:1789115499.172927:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308258944 00000100:00100000:3.0:1789115499.172955:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789115499.172961:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3308:x1876023308258944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115499.172998:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3308:x1876023308258944:12345-0@lo:400:kworker.0 Request processed in 37us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115499.173004:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789115499.173220:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789115499.173238:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308259072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115499.173283:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308259072:12345-0@lo:400:kworker.0 Request processed in 57us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115499.173290:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789115499.173304:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789115499.173310:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876023308259456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115499.173336:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876023308259456:12345-0@lo:400:kworker.0 Request processed in 27us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115499.173341:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789115499.173367:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf5187c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308258944:0@lo:400:kworker.0 00000100:00100000:1.0:1789115499.173379:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf5187480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876023308259456:0@lo:400:kworker.0 00000100:00100000:1.0:1789115499.173428:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf5185680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308259072:0@lo:400:kworker.0 00000100:00100000:1.0:1789115499.173438:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf5184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876023308259200:0@lo:400:kworker.0 00000100:00080000:1.0:1789115499.173477:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115499.179080:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00010000:00010000:3.0:1789115499.235638:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115499.288630:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115499.289539:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288301184 00000100:00100000:1.0:1789115499.289549:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288301184 00000100:00100000:1.0:1789115499.289601:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:1.0:1789115499.289611:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+33:10547:x1876023288301184:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:1.0:1789115499.289635:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115499.289656:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d353c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b64 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.289811:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3543 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.289825:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.289836:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115499.289846:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789115499.290066:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d353c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b64 expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.290882:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b64 expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.290896:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115499.290899:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115499.290903:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6000, rc 0) 00000100:00100000:1.0:1789115499.290983:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+35:10547:x1876023288301184:12345-192.168.203.31@tcp:101:cat.0 Request processed in 1373us (2360us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789115499.291004:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:0.0:1789115499.301145:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115499.303504:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288301312 00000100:00100000:3.0:1789115499.303518:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288301312 00000100:00100000:3.0:1789115499.303609:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:3.0:1789115499.303619:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+35:2352:x1876023288301312:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115499.303635:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115499.303671:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3543 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b64 expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115499.303691:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:3.0:1789115499.303695:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115499.303821:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+34:2352:x1876023288301312:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 202us (2683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115499.303830:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:1.0:1789115499.312198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115499.312475:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288301568 00000100:00100000:3.0:1789115499.312485:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288301568 00000100:00100000:3.0:1789115499.312554:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:3.0:1789115499.312564:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+34:10547:x1876023288301568:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:3.0:1789115499.312867:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+35:10547:x1876023288301568:12345-192.168.203.31@tcp:35:cat.0 Request processed in 302us (676us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789115499.312875:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:2.0:1789115499.435084:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115499.437365:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288301824 00000100:00100000:0.0:1789115499.437456:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288301824 00000100:00100000:0.0:1789115499.437564:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:0.0:1789115499.437577:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+35:10553:x1876023288301824:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1789115499.437611:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115499.437615:0:8213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789115499.437655:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d34a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b3a expref: 35 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.437683:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:0.0:1789115499.437691:0:8213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789115499.438136:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3551 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b6b expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.438290:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.438306:0:8213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3527 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b5d expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.438315:0:8213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.438356:0:8213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b5d expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.438375:0:8213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3527 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b5d expref: 35 pid: 5852 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115499.438421:0:8213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4c24f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308259712:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115499.438580:0:8213:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd88c0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789115499.449431:0:8213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4c24f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308259712:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115499.449483:0:8213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115499.453259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115499.453770:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288301952 00000100:00100000:0.0:1789115499.453779:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288301952 00010000:00010000:0.0:1789115499.453835:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3527 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b5d expref: 36 pid: 5852 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115499.453878:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:0.0:1789115499.453888:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c25a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+36:2352:x1876023288301952:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115499.453902:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115499.453909:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3527 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b5d expref: 36 pid: 5852 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.453923:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b5d expref: 36 pid: 5852 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.453972:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3527 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b5d expref: 36 pid: 5852 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.453989:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115499.453994:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.454008:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.454015:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.454054:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115499.454115:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c25a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+35:2352:x1876023288301952:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 228us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115499.454122:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00010000:00010000:1.0:1789115499.454342:0:8213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.454350:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115499.454367:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789115499.454573:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d3551 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b6b expref: 36 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.454588:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b6b expref: 35 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.454595:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115499.454598:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789115499.454600:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacda00, rc 0) 00000100:00100000:1.0:1789115499.454636:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+35:10553:x1876023288301824:12345-192.168.203.31@tcp:101:dd.0 Request processed in 17062us (19575us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789115499.454643:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:2.0:1789115499.465979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115499.466115:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288302208 00000100:00100000:0.0:1789115499.466124:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288302208 00000100:00100000:0.0:1789115499.466183:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1789115499.466193:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+35:10553:x1876023288302208:12345-192.168.203.31@tcp:36:dd.0 00010000:00010000:1.0:1789115499.467022:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3566 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.467042:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3566 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.467053:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3566 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789115499.467131:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1789115499.467155:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b82689a3 reply state 000000007aef11bf transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3566 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115499.467162:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789115499.468106:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+38:10553:x1876023288302208:12345-192.168.203.31@tcp:36:dd.0 Request processed in 1907us (2128us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789115499.468116:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000020:00080000:1.0:1789115499.468123:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789115499.473347:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3566 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.473363:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3566 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.473370:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3566 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.473376:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115499.473418:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3566 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.473428:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3566 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.473444:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115499.473446:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115499.473451:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3566 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.473457:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3566 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115499.686410:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789115499.686434:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfceda9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308259840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789115499.686507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115499.688935:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308259840 00000100:00100000:0.0:1789115499.688949:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308259840 00000100:00100000:0.0:1789115499.689016:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789115499.689026:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308259840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115499.689063:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115499.689146:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308259840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115499.689165:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789115499.689595:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfceda9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308259840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789115499.825595:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115499.825827:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288302336 00000100:00100000:3.0:1789115499.825843:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288302336 00000100:00100000:3.0:1789115499.825931:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1789115499.825943:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+37:10567:x1876023288302336:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:3.0:1789115499.825981:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115499.826009:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d356d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b72 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115499.826098:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3574 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115499.826114:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3574 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115499.826151:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3574 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115499.826169:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d357b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115499.826176:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d357b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115499.826182:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d357b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115499.826321:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3582 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115499.826332:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b6b expref: 38 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115499.826340:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3582 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115499.826444:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b6b expref: 38 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115499.826461:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b6b expref: 38 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115499.826479:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc89a0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308259968:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115499.826622:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789115499.829854:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115499.830266:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288302592 00000100:00100000:0.0:1789115499.830278:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288302592 00000100:00100000:3.0:1789115499.830463:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc89a0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308259968:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789115499.830496:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3582 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115499.830851:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1789115499.830868:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+39:5590:x1876023288302592:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789115499.831619:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+40:5590:x1876023288302592:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 753us (1776us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789115499.831630:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1789115499.838134:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115499.839864:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288302720 00000100:00100000:2.0:1789115499.839882:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288302720 00010000:00010000:2.0:1789115499.839948:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b6b expref: 40 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115499.840061:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:2.0:1789115499.840073:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+40:2353:x1876023288302720:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115499.840105:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115499.840114:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b6b expref: 40 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.840130:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b6b expref: 40 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.840158:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3558 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b6b expref: 40 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.840187:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:2.0:1789115499.840193:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3582 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.840238:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.840247:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3582 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.840293:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115499.840418:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+39:2353:x1876023288302720:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 311us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115499.840428:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00010000:00010000:0.0:1789115499.841190:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841202:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115499.841270:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789115499.841276:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115499.841331:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841346:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841358:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3574 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841365:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3574 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841372:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3574 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841425:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115499.841430:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3574 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841438:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3574 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841452:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:0.0:1789115499.841455:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115499.841460:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3574 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841467:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3574 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841482:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d357b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841488:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d357b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841495:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d357b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841500:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115499.841503:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d357b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841510:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d357b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841529:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcf2157200) 00010000:00010000:0.0:1789115499.841532:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115499.841535:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d357b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841541:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d357b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841592:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d356d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b72 expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841606:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b72 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115499.841614:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115499.841616:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115499.841619:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb800, rc 0) 00000100:00100000:0.0:1789115499.841691:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+38:10567:x1876023288302336:12345-192.168.203.31@tcp:101:stat.0 Request processed in 15749us (16110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115499.841701:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:0.0:1789115499.971288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115499.971464:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288302976 00000100:00100000:1.0:1789115499.971477:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288302976 00000100:00100000:1.0:1789115499.971564:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:1.0:1789115499.971576:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+38:10573:x1876023288302976:12345-192.168.203.31@tcp:36:truncate.0 00010000:00010000:1.0:1789115499.971670:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115499.971715:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3582 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b72 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.971755:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115499.971762:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789115499.972063:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3589 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.972082:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115499.972094:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789115499.972170:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1789115499.972212:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c0315e07 reply state 0000000066fe7212 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115499.972231:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789115499.972593:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+40:10573:x1876023288302976:12345-192.168.203.31@tcp:36:truncate.0 Request processed in 810us (1109us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789115499.972603:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000020:00080000:1.0:1789115499.972609:0:5851:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789115499.975647:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.975669:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3589 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.975676:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3589 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.975682:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115499.975688:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3589 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.975697:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3589 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.975716:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:2.0:1789115499.975719:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115499.975725:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3589 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115499.975754:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3589 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115500.160157:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115500.160280:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288303104 00000100:00100000:1.0:1789115500.160296:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288303104 00000100:00100000:1.0:1789115500.160443:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:1.0:1789115500.160457:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+39:10587:x1876023288303104:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:1.0:1789115500.160501:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1789115500.160530:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789115500.160541:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3590 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b79 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.160628:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3597 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.160645:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3597 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.160658:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3597 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.160685:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d359e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.160692:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d359e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.160698:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d359e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.160829:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.160839:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.160869:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115500.160916:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789115500.160921:0:8213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115500.160949:0:8213:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.160963:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.160973:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3597 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.160980:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3597 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.160987:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3597 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.160994:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115500.160999:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3597 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.161008:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3597 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.161034:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115500.161038:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115500.161043:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3597 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.161059:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3597 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.161077:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d359e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.161084:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d359e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.161090:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d359e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.161095:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115500.161099:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d359e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.161105:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d359e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.161125:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcd01ae500) 00010000:00010000:1.0:1789115500.161128:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115500.161131:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d359e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.161137:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d359e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.161176:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3590 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b79 expref: 41 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.161190:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b79 expref: 40 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.161205:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115500.161207:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115500.161211:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7e00, rc 0) 00000100:00100000:1.0:1789115500.161318:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+40:10587:x1876023288303104:12345-192.168.203.31@tcp:101:stat.0 Request processed in 863us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115500.161325:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:1.0:1789115500.229819:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115500.230309:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288303360 00000100:00100000:2.0:1789115500.230325:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288303360 00000100:00100000:2.0:1789115500.230456:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:2.0:1789115500.230469:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+40:10597:x1876023288303360:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789115500.230499:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115500.230530:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d35ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b80 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115500.230682:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789115500.230839:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d35ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b80 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.230856:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcf2157400) 00010000:00010000:2.0:1789115500.230859:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789115500.230866:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d35ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b80 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.230883:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacda00, rc 0) 00000100:00100000:2.0:1789115500.231040:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+41:10597:x1876023288303360:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 573us (1230us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1789115500.231049:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:2.0:1789115500.235618:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115500.235684:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288303616 00000100:00100000:1.0:1789115500.235697:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288303616 00000100:00100000:1.0:1789115500.235825:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1789115500.235836:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+41:10597:x1876023288303616:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1789115500.237455:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+42:10597:x1876023288303616:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 1607us (1840us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789115500.237469:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00010000:00010000:1.0:1789115500.261051:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115500.317521:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115500.317644:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288303872 00000100:00100000:1.0:1789115500.317657:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288303872 00000100:00100000:1.0:1789115500.317742:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:1.0:1789115500.317754:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+42:10603:x1876023288303872:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1789115500.317786:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115500.317812:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d35ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b87 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.317941:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.317981:0:8213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b79 expref: 43 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.317991:0:8213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.318036:0:8213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b79 expref: 43 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.318052:0:8213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b79 expref: 43 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115500.318068:0:8213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308260096:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115500.318191:0:8213:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcffab7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789115500.330743:0:8213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308260096:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115500.330783:0:8213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115500.331556:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115500.332156:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288304000 00000100:00100000:1.0:1789115500.332168:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288304000 00010000:00010000:1.0:1789115500.332240:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b79 expref: 44 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115500.332292:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1789115500.332303:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+44:2352:x1876023288304000:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115500.332322:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115500.332348:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b79 expref: 44 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.332363:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b79 expref: 44 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.332423:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b79 expref: 44 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.332444:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115500.332449:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.332459:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.332467:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.332501:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115500.332575:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+43:2352:x1876023288304000:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 273us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115500.332584:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00010000:00010000:0.0:1789115500.332726:0:8213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.332746:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115500.332770:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789115500.332959:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d35ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b87 expref: 44 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.332977:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b87 expref: 43 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.332985:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115500.332988:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789115500.332991:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6400, rc 0) 00000100:00100000:0.0:1789115500.333020:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+43:10603:x1876023288303872:12345-192.168.203.31@tcp:101:bash.0 Request processed in 15269us (15515us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789115500.333028:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:3.0:1789115500.336154:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115500.336752:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288304256 00000100:00100000:2.0:1789115500.336767:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288304256 00000100:00100000:2.0:1789115500.336861:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:2.0:1789115500.336874:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+43:10603:x1876023288304256:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:2.0:1789115500.337784:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d35cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.337804:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d35cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.337815:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d35cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789115500.337863:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1789115500.337881:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cb992dbe reply state 00000000255c19ae transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d35cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115500.337888:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789115500.338032:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+46:10603:x1876023288304256:12345-192.168.203.31@tcp:36:bash.0 Request processed in 1159us (1897us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789115500.338041:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000020:00080000:2.0:1789115500.338047:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789115500.341211:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d35cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.341245:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d35cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.341253:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d35cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.341281:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacde00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115500.341287:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d35cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.341296:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d35cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.341317:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115500.341320:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115500.341325:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d35cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.341332:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacde00/0xa47abda6516d35cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115500.348853:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115500.349512:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288304384 00000100:00100000:0.0:1789115500.349525:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288304384 00000100:00100000:0.0:1789115500.349654:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:0.0:1789115500.349664:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+45:10603:x1876023288304384:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1789115500.349693:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115500.349730:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d35d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b8e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.349833:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d35dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.349865:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b87 expref: 46 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.349873:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d35dd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.349907:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b87 expref: 46 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.349917:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b87 expref: 46 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115500.349929:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfceda9d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308260224:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115500.350033:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfc2d2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789115500.356667:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115500.356710:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfceda9d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308260224:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115500.356752:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d35dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115500.356777:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288304512 00000100:00100000:1.0:1789115500.356787:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288304512 00010000:00010000:1.0:1789115500.356836:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b87 expref: 47 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115500.356872:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1789115500.356880:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+47:2352:x1876023288304512:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115500.356896:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115500.356902:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b87 expref: 47 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.356912:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b87 expref: 47 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.356947:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b87 expref: 47 pid: 8213 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.356961:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115500.356965:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d35dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.356974:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d35dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.356980:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d35dd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.357005:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115500.357066:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+46:2352:x1876023288304512:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 186us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115500.357075:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00010000:00010000:0.0:1789115500.357077:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d35dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.357084:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d35dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115500.357209:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789115500.357215:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115500.357253:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d35dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.357304:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d35d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b8e expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.357322:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d35dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b8e expref: 45 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.357330:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115500.357333:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115500.357336:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e000, rc 0) 00000100:00100000:0.0:1789115500.357412:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+45:10603:x1876023288304384:12345-192.168.203.31@tcp:101:bash.0 Request processed in 7749us (8572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115500.357421:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:3.0:1789115500.364669:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115500.365265:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288304768 00000100:00100000:0.0:1789115500.365277:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288304768 00000100:00100000:0.0:1789115500.365427:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1789115500.365450:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd8a4e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+45:10603:x1876023288304768:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:0.0:1789115500.365773:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd8a4e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+46:10603:x1876023288304768:12345-192.168.203.31@tcp:35:bash.0 Request processed in 326us (1116us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789115500.365783:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:3.0:1789115500.470080:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115500.470643:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288305024 00000100:00100000:1.0:1789115500.470656:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288305024 00000100:00100000:1.0:1789115500.470724:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:1.0:1789115500.470736:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+46:10613:x1876023288305024:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115500.470771:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115500.470799:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b95 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115500.470929:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1789115500.471052:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b95 expref: 48 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.471083:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcf2157400) 00010000:00010000:1.0:1789115500.471085:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789115500.471090:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b95 expref: 48 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.471104:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6400, rc 0) 00000100:00100000:1.0:1789115500.471445:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+47:10613:x1876023288305024:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 710us (1378us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1789115500.471453:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:3.0:1789115500.475781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115500.476808:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288305152 00000100:00100000:1.0:1789115500.476823:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288305152 00000100:00100000:1.0:1789115500.476956:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:1.0:1789115500.476970:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+47:10613:x1876023288305152:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:1.0:1789115500.477081:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477103:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477119:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477150:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477159:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477190:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477350:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3600 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477359:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477367:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789115500.477453:0:8213:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477480:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477487:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477495:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477502:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115500.477507:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477516:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477531:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115500.477540:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115500.477547:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477555:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d35f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477573:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477580:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477586:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477593:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115500.477596:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477602:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477611:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcd01ae500) 00010000:00010000:1.0:1789115500.477613:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115500.477616:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477622:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d35f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477640:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477654:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3600 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477660:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.477666:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115500.477670:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.478018:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3600 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.478030:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115500.478032:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115500.478036:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3600 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.478042:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3600 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115500.478206:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+47:10613:x1876023288305152:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 1236us (2439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115500.478216:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:3.0:1789115500.488046:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115500.488922:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288305408 00000100:00100000:1.0:1789115500.488937:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288305408 00000100:00100000:1.0:1789115500.489069:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:1.0:1789115500.489082:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+47:10613:x1876023288305408:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1789115500.489727:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+48:10613:x1876023288305408:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 646us (1693us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789115500.489753:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1789115500.544572:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115500.544737:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288305664 00000100:00100000:2.0:1789115500.544758:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288305664 00000100:00100000:2.0:1789115500.544888:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:2.0:1789115500.544902:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+48:10616:x1876023288305664:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789115500.544933:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115500.544958:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3607 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3b9c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545048:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d360e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545096:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d360e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545118:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d360e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545146:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d3615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545153:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d3615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545160:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d3615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545341:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d361c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545350:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d361c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545357:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d361c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115500.545367:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789115500.545559:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d360e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545568:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d360e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545575:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d360e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545589:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacce00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115500.545594:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d360e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545603:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d360e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545617:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:2.0:1789115500.545620:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115500.545627:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d360e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545633:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d360e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545649:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d3615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545655:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d3615 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545660:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d3615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545666:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115500.545668:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d3615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545674:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d3615 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545693:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcc5118500) 00010000:00010000:2.0:1789115500.545696:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115500.545699:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d3615 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545705:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d3615 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545755:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3607 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b9c expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545769:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d361c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b9c expref: 50 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.545776:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:2.0:1789115500.545779:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789115500.545781:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacd000, rc 0) 00000100:00100000:2.0:1789115500.545869:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+50:10616:x1876023288305664:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 971us (1310us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789115500.545877:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:3.0:1789115500.551696:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115500.551753:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115500.551936:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288305792 00000100:00100000:0.0:1789115500.551949:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288305792 00000100:00100000:0.0:1789115500.552024:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:0.0:1789115500.552036:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+50:10616:x1876023288305792:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:0.0:1789115500.552140:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d362a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.552186:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d362a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.552200:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d362a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.552457:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d362a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.552465:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d362a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.552472:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d362a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.552479:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115500.552484:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d362a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.552492:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d362a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.552508:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115500.552511:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789115500.552517:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d362a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.552523:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d362a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115500.552618:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+50:10616:x1876023288305792:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 582us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115500.552636:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:2.0:1789115500.552776:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288305920 00000100:00100000:2.0:1789115500.552782:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288305920 00000100:00100000:2.0:1789115500.552839:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1789115500.552848:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+50:2353:x1876023288305920:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115500.552862:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115500.552881:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d361c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b9c expref: 50 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115500.552904:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:2.0:1789115500.552908:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115500.552930:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+49:2353:x1876023288305920:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 84us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115500.552937:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1789115500.560083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115500.560185:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288306176 00000100:00100000:0.0:1789115500.560197:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288306176 00000100:00100000:0.0:1789115500.560294:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1789115500.560306:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+49:10616:x1876023288306176:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1789115500.560876:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+50:10616:x1876023288306176:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 570us (805us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789115500.560885:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1789115500.727506:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115500.727620:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288306432 00000100:00100000:1.0:1789115500.727632:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288306432 00000100:00100000:1.0:1789115500.727714:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:1.0:1789115500.727725:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+50:10634:x1876023288306432:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:1.0:1789115500.727754:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115500.727782:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3631 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3ba3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.729803:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d3638 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.729835:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d3638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.729851:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d3638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115500.729879:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789115500.730092:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3631 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ba3 expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.730118:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d3638 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ba3 expref: 52 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.730129:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115500.730132:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789115500.730136:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7e00, rc 0) 00000100:00100000:1.0:1789115500.730324:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+52:10634:x1876023288306432:12345-192.168.203.31@tcp:101:cat.0 Request processed in 2599us (2831us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789115500.730336:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:3.0:1789115500.769129:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115500.769348:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288306560 00000100:00100000:1.0:1789115500.769364:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288306560 00000100:00100000:1.0:1789115500.769553:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:1.0:1789115500.769568:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+52:10635:x1876023288306560:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115500.769601:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115500.769629:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3646 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3baa expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.769736:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d364d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.769753:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d364d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.769767:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d364d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115500.769843:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1789115500.769847:0:8213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115500.769873:0:8213:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d364d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.769904:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3646 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3baa expref: 54 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.769927:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d364d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3baa expref: 53 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.769950:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115500.769954:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789115500.769958:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6400, rc 0) 00000100:00100000:1.0:1789115500.770046:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+53:10635:x1876023288306560:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 482us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115500.770055:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:3.0:1789115500.777752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115500.778421:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288306944 00000100:00100000:1.0:1789115500.778438:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288306944 00000100:00100000:1.0:1789115500.778598:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1789115500.778612:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+53:10635:x1876023288306944:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1789115500.779137:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+54:10635:x1876023288306944:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 526us (1390us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789115500.779160:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:3.0:1789115500.781053:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115500.781867:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288307072 00000100:00100000:1.0:1789115500.781877:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288307072 00000100:00100000:1.0:1789115500.781954:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:1.0:1789115500.781966:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+54:10635:x1876023288307072:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:1.0:1789115500.781982:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789115500.782009:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d35dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b8e expref: 54 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.782039:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d3638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ba3 expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.782052:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d34e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b4f expref: 52 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.782724:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115500.782737:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115500.782809:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+51:10635:x1876023288307072:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 845us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115500.782818:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1789115500.786057:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115500.786143:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288307200 00000100:00100000:1.0:1789115500.786153:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288307200 00000100:00100000:1.0:1789115500.786210:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:1.0:1789115500.786232:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+51:10635:x1876023288307200:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:1.0:1789115500.786341:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3654 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.786357:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3654 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115500.786368:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3654 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789115500.786665:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789115500.786872:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789115500.786938:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789115500.787041:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+51:10635:x1876023288307200:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 821us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115500.787050:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1789115500.811182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115500.811576:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288307328 00000100:00100000:0.0:1789115500.811586:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288307328 00000100:00100000:0.0:1789115500.811644:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1789115500.811655:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+51:10637:x1876023288307328:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115500.811674:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115500.811696:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d365b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3bb1 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.811779:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3662 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.811794:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3662 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.811808:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3662 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.811821:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3669 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.811846:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.811853:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.811946:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3670 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.811955:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.811962:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115500.811998:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789115500.812002:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115500.812019:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812029:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812037:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3662 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812043:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3662 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812049:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3662 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812064:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115500.812068:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3662 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812075:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3662 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812087:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:0.0:1789115500.812090:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115500.812094:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3662 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812100:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3662 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812111:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812117:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3669 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812122:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812126:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ea00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115500.812129:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812134:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3669 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812152:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcd044f600) 00010000:00010000:0.0:1789115500.812154:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115500.812157:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3669 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812163:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3669 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812195:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d365b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bb1 expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812209:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bb1 expref: 52 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115500.812216:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae500) 00010000:00010000:0.0:1789115500.812233:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789115500.812236:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e000, rc 0) 00000100:00100000:0.0:1789115500.812300:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+52:10637:x1876023288307328:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 646us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115500.812308:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00010000:00010000:1.0:1789115501.285427:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789115501.349307:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789115501.349315:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789115501.349364:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789115501.349371:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789115501.349833:0:12072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4c25a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876023308260352:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789115501.349923:0:12072:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd88c0840 going to sleep for 11 seconds 00000100:00100000:2.0:1789115501.364338:0:12072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4c25a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876023308260352:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789115501.365041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115501.365160:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288307456 00000100:00100000:1.0:1789115501.365168:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288307456 00000100:00100000:1.0:1789115501.365265:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1789115501.365287:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6dbf7574-92fb-4b89-af78-41319f924699+52:10648:x1876023288307456:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789115501.365377:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6dbf7574-92fb-4b89-af78-41319f924699+52:10648:x1876023288307456:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 Request processed in 91us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115501.365411:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:3.0:1789115501.379824:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115501.379899:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288307584 00000100:00100000:2.0:1789115501.379909:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288307584 00000100:00100000:2.0:1789115501.379970:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:2.0:1789115501.379981:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+52:10648:x1876023288307584:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789115501.380011:0:5852:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789115501.380124:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+52:10648:x1876023288307584:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 145us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115501.380132:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1789115501.391324:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115501.392091:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288307712 00000100:00100000:0.0:1789115501.392103:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288307712 00000100:00100000:0.0:1789115501.392154:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:0.0:1789115501.392164:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+52:10648:x1876023288307712:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789115501.392585:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3677 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.392605:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3677 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.392628:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3677 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.392684:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d367e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.392692:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d367e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.392768:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d367e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.392931:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3685 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.392940:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.392947:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115501.393057:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789115501.393062:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115501.393075:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393086:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3677 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393092:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3677 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393110:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3677 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393116:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115501.393120:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3677 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393127:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3677 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393140:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:0.0:1789115501.393143:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115501.393147:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3677 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393153:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3677 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393166:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d367e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393172:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d367e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393177:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d367e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393182:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ea00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115501.393185:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d367e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393200:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d367e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393208:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8dfcd044f600) 00010000:00010000:0.0:1789115501.393210:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115501.393287:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d367e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393295:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d367e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393311:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393317:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3685 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393323:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393328:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115501.393331:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393337:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3685 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.393345:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae500) 00010000:00010000:0.0:1789115501.393347:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115501.393350:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3685 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.395719:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3685 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115501.395847:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+52:10648:x1876023288307712:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 3680us (4527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115501.395858:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:0.0:1789115501.401471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115501.402133:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288307968 00000100:00100000:2.0:1789115501.402142:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288307968 00000100:00100000:2.0:1789115501.402199:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:2.0:1789115501.402209:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+52:10648:x1876023288307968:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789115501.402250:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115501.402271:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d368c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3bb8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.402378:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d3693 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.402407:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d3693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.402418:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d3693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115501.402429:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789115501.402595:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d3693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.402604:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d3693 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.402611:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d3693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.402617:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacce00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115501.402621:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d3693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.402629:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d3693 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.402642:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae500) 00010000:00010000:2.0:1789115501.402651:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789115501.402656:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d3693 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.402663:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d3693 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.402773:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d368c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bb8 expref: 54 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.402894:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:2.0:1789115501.402897:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789115501.402901:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d368c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bb8 expref: 54 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.402912:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacc000, rc 0) 00000100:00100000:2.0:1789115501.403248:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+53:10648:x1876023288307968:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1040us (1787us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1789115501.403257:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:1.0:1789115501.412055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115501.412134:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288308096 00000100:00100000:0.0:1789115501.412143:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288308096 00000100:00100000:0.0:1789115501.412198:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:0.0:1789115501.412207:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+53:10648:x1876023288308096:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789115501.412254:0:8213:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789115501.412349:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+53:10648:x1876023288308096:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 143us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115501.412357:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1789115501.424138:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115501.424459:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288308352 00000100:00100000:0.0:1789115501.424469:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288308352 00000100:00100000:0.0:1789115501.424527:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1789115501.424538:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+53:10648:x1876023288308352:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115501.424559:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115501.424562:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789115501.424589:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d364d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3baa expref: 53 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.424609:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:0.0:1789115501.424615:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115501.424637:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d36a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3bbf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789115501.425042:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789115501.425619:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d36a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.425636:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d36a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.425647:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d36a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.425708:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d36a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bbf expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.425722:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d36a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bbf expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.425730:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:0.0:1789115501.425733:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115501.425735:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28ea00, rc 0) 00000100:00100000:0.0:1789115501.425800:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+54:10648:x1876023288308352:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1264us (1670us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789115501.425809:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1789115501.437324:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115501.437607:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288308608 00000100:00100000:2.0:1789115501.437617:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288308608 00000100:00100000:2.0:1789115501.437681:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:2.0:1789115501.437691:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+54:10648:x1876023288308608:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789115501.437750:0:8213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115501.437780:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d36a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bbf expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.437798:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:2.0:1789115501.437819:0:8213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789115501.437844:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d36b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.437857:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d36b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.437868:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d36b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.437925:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d36bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x61a8df8b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.437933:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d36bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x61a8df8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.437939:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d36bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x61a8df8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.438023:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d36b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.438030:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d36b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.438037:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d36b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.438043:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115501.438047:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d36b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.438055:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d36b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.438071:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:2.0:1789115501.438074:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115501.438078:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d36b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.438085:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d36b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.438095:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d36bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x61a8df8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.438101:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d36bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x61a8df8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.438107:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d36bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x61a8df8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.438112:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacce00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115501.438115:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d36bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x61a8df8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.438121:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d36bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x61a8df8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.438128:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x61a8df8b (ffff8dfcc5118700) 00010000:00010000:2.0:1789115501.438131:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115501.438133:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d36bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x61a8df8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.438139:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d36bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x61a8df8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115501.438311:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+53:10648:x1876023288308608:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 620us (1003us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789115501.438319:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:3.0:1789115501.444869:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115501.444930:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288308736 00000100:00100000:0.0:1789115501.444940:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288308736 00000100:00100000:0.0:1789115501.445226:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:0.0:1789115501.445237:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+53:10648:x1876023288308736:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115501.445263:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115501.445284:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d36c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3bc6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.445317:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d36cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.445330:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d36cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.445341:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d36cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.445607:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d36c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bc6 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.445625:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d36cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bc6 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.445635:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:0.0:1789115501.445638:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789115501.445642:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f600, rc 0) 00000100:00100000:0.0:1789115501.445701:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+54:10648:x1876023288308736:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 466us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115501.445708:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:3.0:1789115501.466228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115501.466268:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288308992 00000100:00100000:3.0:1789115501.466277:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288308992 00000100:00100000:3.0:1789115501.466337:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:3.0:1789115501.466346:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+54:10648:x1876023288308992:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789115501.466444:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d36d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.466460:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d36d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.466470:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d36d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789115501.466773:0:8213:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1789115501.466783:0:8213:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 318679400581ns, next at 319679397874ns, rc = 0 00000004:00010000:3.0:1789115501.466868:0:8213:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000eed9bf3f reply state 00000000d71c88f6 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d36d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115501.466878:0:8213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789115501.466972:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+56:10648:x1876023288308992:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 625us (761us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789115501.466980:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:3.0:1789115501.475327:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115501.475363:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288309120 00000100:00100000:3.0:1789115501.475373:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288309120 00000100:00100000:3.0:1789115501.475445:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:3.0:1789115501.475455:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+56:10648:x1876023288309120:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789115501.475479:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115501.475500:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d36d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3bcd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.475583:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d36d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bcd expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.475598:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d36d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bcd expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.475617:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:3.0:1789115501.475620:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789115501.475624:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb800, rc 0) 00000100:00100000:3.0:1789115501.475685:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+57:10648:x1876023288309120:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 231us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115501.475692:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00010000:00010000:2.0:1789115501.476221:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d36d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.476233:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d36d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.476240:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d36d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.476245:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115501.476251:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d36d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.476259:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d36d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.476272:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:2.0:1789115501.476275:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789115501.476279:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d36d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.476285:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d36d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115501.481493:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115501.481626:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288309248 00000100:00100000:0.0:1789115501.481636:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288309248 00000100:00100000:0.0:1789115501.481686:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1789115501.481694:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1876023288309248:12345-192.168.203.31@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789115501.481734:0:6699:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:0.0:1789115501.481762:0:6699:0:(genops.c:1385:class_connect()) connect: client 6dbf7574-92fb-4b89-af78-41319f924699, cookie 0xa47abda6516d36e0 00002000:00100000:0.0:1789115501.481774:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6dbf7574-92fb-4b89-af78-41319f924699/ffff8dfce2908000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398e ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789115501.481794:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:0.0:1789115501.482004:0:6699:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789115501.482034:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8dfcc70ba000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789115501.482110:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2349:x1876023288309248:12345-192.168.203.31@tcp:8:lhsmtool_posix.0 Request processed in 416us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115501.482119:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1789115501.484895:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115501.484982:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288309376 00000100:00100000:2.0:1789115501.484992:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288309376 00000100:00100000:2.0:1789115501.485070:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1789115501.485093:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+6:0:x1876023288309376:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789115501.485732:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1789115501.580024:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6dbf7574-92fb-4b89-af78-41319f924699 00000001:00080000:3.0:1789115501.580045:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1789115501.586093:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+5:0:x1876023288309376:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 100992us (101199us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789115501.586107:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:3.0:1789115501.598690:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115501.598960:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288309632 00000100:00100000:1.0:1789115501.598969:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288309632 00000100:00100000:1.0:1789115501.599026:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1789115501.599036:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+56:10648:x1876023288309632:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789115501.599272:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+57:10648:x1876023288309632:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 236us (589us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789115501.599279:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1789115501.602987:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115501.603063:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288309888 00000100:00100000:2.0:1789115501.603072:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288309888 00000100:00100000:2.0:1789115501.603127:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:2.0:1789115501.603138:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+57:10648:x1876023288309888:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789115501.603272:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+57:10648:x1876023288309888:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 135us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115501.603280:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:1.0:1789115501.610147:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115501.610688:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288310016 00000100:00100000:3.0:1789115501.610708:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288310016 00000100:00100000:3.0:1789115501.610772:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:3.0:1789115501.610783:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+57:10648:x1876023288310016:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789115501.610804:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115501.610825:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d36e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3bd4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.610900:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d36ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.610922:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d36ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.610935:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d36ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115501.610972:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789115501.610990:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d36ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.611017:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d36e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bd4 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.611032:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d36ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bd4 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.611041:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:3.0:1789115501.611044:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789115501.611048:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb600, rc 0) 00000100:00100000:3.0:1789115501.611111:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+58:10648:x1876023288310016:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 330us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115501.611119:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:1.0:1789115501.616822:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115501.616960:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288310144 00000100:00100000:0.0:1789115501.616969:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288310144 00000100:00100000:0.0:1789115501.617026:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1789115501.617037:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+5:2352:x1876023288310144:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115501.617055:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115501.617077:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d36f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3bdb expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789115501.617104:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3bc6c, blocks: 0x1 00010000:00010000:0.0:1789115501.617124:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=318s v=(0 0) 00010000:00010000:0.0:1789115501.617129:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115501.617139:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d36f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bdb expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.617184:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d36f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bdb expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.617197:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e400, rc 0) 00000100:00100000:0.0:1789115501.617275:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288310144:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 240us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115501.617282:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1789115501.632659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115501.632831:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288310400 00000100:00100000:2.0:1789115501.632841:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288310400 00000100:00100000:2.0:1789115501.632894:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:2.0:1789115501.632904:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+58:10648:x1876023288310400:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789115501.633005:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+58:10648:x1876023288310400:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 102us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115501.633013:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:0.0:1789115501.638411:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115501.638493:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288310528 00000100:00100000:3.0:1789115501.638503:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288310528 00000100:00100000:3.0:1789115501.638562:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:3.0:1789115501.638572:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:10648:x1876023288310528:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789115501.638590:0:6885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115501.638618:0:6885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d36fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3be2 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.638649:0:6885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d36f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bdb expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.638674:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115501.638678:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115501.638684:0:6885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d36fc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be2 expref: 7 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.638719:0:6885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d36f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bdb expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.638732:0:6885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d36f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bdb expref: 7 pid: 6697 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115501.638891:0:6885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf52d1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6885:1876023308260480:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115501.638977:0:6885:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc62d4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115501.641221:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115501.642708:0:6885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf52d1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6885:1876023308260480:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789115501.642741:0:6885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d36fc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be2 expref: 7 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.642763:0:6885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ebc00, rc 0) 00000100:00100000:3.0:1789115501.642830:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:10648:x1876023288310528:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 4259us (4450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115501.642856:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:2.0:1789115501.643288:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288310656 00000100:00100000:2.0:1789115501.643297:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288310656 00010000:00010000:2.0:1789115501.643329:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d36f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bdb expref: 7 pid: 6697 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115501.643366:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1789115501.643376:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+7:2352:x1876023288310656:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115501.643414:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115501.643439:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d36f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bdb expref: 7 pid: 6697 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.643464:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d36f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bdb expref: 7 pid: 6697 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.643490:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d36f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bdb expref: 7 pid: 6697 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.643504:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115501.643508:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115501.643516:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d36fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be2 expref: 6 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.643526:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d36fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be2 expref: 6 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.643561:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d36fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be2 expref: 6 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115501.643576:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4c26d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1876023308260608:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789115501.643637:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd88c0840 going to sleep for 11 seconds 00000100:00100000:2.0:1789115501.654454:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4c26d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1876023308260608:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789115501.654484:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115501.654543:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288310656:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 11168us (13339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115501.654555:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000040:00080000:2.0:1789115501.659129:0:12385:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789115501.659138:0:12385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789115501.659173:0:12385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789115501.659178:0:12385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789115501.662512:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115501.663584:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288310784 00000100:00100000:2.0:1789115501.663597:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288310784 00002000:00100000:2.0:1789115501.663653:0:6704:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8dfceda9cf00 x1876023288310784/t0(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:317/0 lens 504/0 e 0 to 0 dl 1789115512 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789115501.663664:0:6704:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfceda9cf00 with x1876023288310784 ext(0->8) 00002000:00010000:2.0:1789115501.663670:0:6704:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfceda9cf00 00000100:00100000:2.0:1789115501.663704:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:2.0:1789115501.663715:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288310784:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789115501.665163:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288310784:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 1434us (2644us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789115501.665176:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00002000:00100000:2.0:1789115501.665187:0:6704:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8dfceda9cf00 x1876023288310784/t4294967302(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:317/0 lens 504/448 e 0 to 0 dl 1789115512 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789115501.665197:0:6704:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfceda9cf00 with x1876023288310784 ext(0->8) 00002000:00010000:2.0:1789115501.665203:0:6704:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfceda9cf00 00000100:00100000:1.0:1789115501.671836:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115501.671950:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288310912 00000100:00100000:2.0:1789115501.671960:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288310912 00000100:00100000:2.0:1789115501.672022:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:2.0:1789115501.672033:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+58:10648:x1876023288310912:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789115501.749038:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:2.0:1789115501.749068:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:2.0:1789115501.749115:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dfcedacf780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789115501.749120:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcffd01600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcedacf180 00000020:00080000:2.0:1789115501.749124:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcffd01f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcffd2e000 00000004:00080000:2.0:1789115501.749158:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:2.0:1789115501.749183:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789115501.749209:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789115501.749637:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789115501.749791:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4c26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308260736:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789115501.749867:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115501.750407:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308260736 00000100:00100000:1.0:1789115501.750415:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308260736 00000100:00100000:1.0:1789115501.750472:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789115501.750482:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876023308260736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789115501.750508:0:6699:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789115501.750539:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa3bc69, atime: 0x6aa3bc69, ctime: 0x6aa3bc69, blocks: 0x1 00010000:00010000:1.0:1789115501.750547:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a674027/0xa47abda6516d3703 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.750568:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=318s v=(0 0) 00010000:00010000:1.0:1789115501.750573:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115501.750580:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a674027/0xa47abda6516d3703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.750597:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a674027/0xa47abda6516d3703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.750606:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a674027/0xa47abda6516d3703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.750615:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a674027/0xa47abda6516d3703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.750633:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1789115501.751990:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789115501.755839:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4c25a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308260864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789115501.755925:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115501.755984:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308260864 00000100:00100000:2.0:1789115501.755991:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308260864 00000100:00100000:2.0:1789115501.756043:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789115501.756051:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308260864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789115501.756239:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789115501.756243:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789115500 00002000:00010000:2.0:1789115501.756246:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789115501.756248:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789115500 -> 1789115500 00002000:00010000:2.0:1789115501.756251:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789115501.756293:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308260864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 241us (366us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789115501.756301:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789115501.756323:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789115501.756355:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dfcf4c25a40/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789115501.756362:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4c25a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308260864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789115501.756494:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+13:10648:x1876023288310912:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 84461us (84665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115501.756518:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:1.0:1789115501.757085:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1876023308260736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6600us (7213us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789115501.757094:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1789115501.758617:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789115501.758628:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a674027/0xa47abda6516d3703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.758641:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:2.0:1789115501.758645:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a674027/0xa47abda6516d3703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.758664:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a674027/0xa47abda6516d3703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.758686:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a674027/0xa47abda6516d3703 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.758702:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a674027/0xa47abda6516d3703 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.758721:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115501.758723:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115501.758725:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789115501.758975:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dfcf4c26d00/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789115501.758985:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4c26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308260736:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789115501.760514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115501.760853:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288311040 00000100:00100000:2.0:1789115501.760863:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288311040 00000100:00100000:2.0:1789115501.760924:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1789115501.760933:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+8:2350:x1876023288311040:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789115501.838757:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+8:2350:x1876023288311040:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 77816us (78241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115501.838780:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000001:00080000:2.0:1789115501.838811:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1789115501.838819:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1789115501.844863:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115501.845869:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288311296 00000100:00100000:3.0:1789115501.845881:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288311296 00000100:00100000:3.0:1789115501.845944:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:3.0:1789115501.845954:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+13:10648:x1876023288311296:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789115501.846004:0:8213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115501.846032:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d36ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bd4 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.846051:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:3.0:1789115501.846055:0:8213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789115501.846092:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d370a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.846105:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d370a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.846115:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d370a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789115501.846685:0:8213:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a920c359 reply state 000000003acb0782 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d370a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115501.846803:0:8213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789115501.846915:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+14:10648:x1876023288311296:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 960us (2060us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789115501.846924:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00010000:00010000:0.0:1789115501.849317:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d370a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.849334:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d370a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.849341:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d370a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.849348:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115501.849353:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d370a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.849415:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d370a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.849433:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:0.0:1789115501.849436:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115501.849441:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d370a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.849446:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d370a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115501.850226:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115501.850682:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288311424 00000100:00100000:3.0:1789115501.850745:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288311424 00000100:00100000:3.0:1789115501.850830:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:3.0:1789115501.850840:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288311424:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789115501.851076:0:6885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789115501.851079:0:6885:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789115500 -> 1789115499 00002000:00010000:3.0:1789115501.851082:0:6885:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789115497 00002000:00010000:3.0:1789115501.851083:0:6885:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789115500 -> 1789115499 00002000:00010000:3.0:1789115501.851086:0:6885:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789115501.851161:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288311424:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 322us (947us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789115501.851170:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1789115501.858980:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115501.859062:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288311680 00000100:00100000:3.0:1789115501.859071:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288311680 00000100:00100000:3.0:1789115501.859135:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:3.0:1789115501.859146:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5185680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+13:10648:x1876023288311680:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789115501.859222:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.859240:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d36cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bc6 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.859263:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.859297:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d36cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bc6 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.859311:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d36cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bc6 expref: 13 pid: 5851 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115501.859325:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf52d2940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308260992:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115501.859440:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc62d4780 going to sleep for 11 seconds 00000100:00100000:2.0:1789115501.864543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115501.864965:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf52d2940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308260992:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789115501.864991:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115501.865181:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288311808 00000100:00100000:0.0:1789115501.865188:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288311808 00010000:00010000:0.0:1789115501.865234:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d36cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bc6 expref: 14 pid: 5851 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115501.865313:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:0.0:1789115501.865323:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaada580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+14:2353:x1876023288311808:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115501.865338:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115501.865345:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d36cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bc6 expref: 14 pid: 5851 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.865357:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d36cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bc6 expref: 14 pid: 5851 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.865408:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d36cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bc6 expref: 14 pid: 5851 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.865440:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:0.0:1789115501.865445:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.865455:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.865462:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.865486:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115501.865535:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaada580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+13:2353:x1876023288311808:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 214us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115501.865543:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00010000:00010000:1.0:1789115501.866884:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.866896:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.866923:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.866941:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.866947:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.866953:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115501.866958:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.866966:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.866981:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:1.0:1789115501.866984:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789115501.866988:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.866994:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb600/0xa47abda6516d3711 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115501.867070:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5185680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+12:10648:x1876023288311680:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 7923us (8095us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789115501.867079:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:0.0:1789115501.876416:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115501.876580:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288311936 00000100:00100000:3.0:1789115501.876590:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288311936 00000100:00100000:3.0:1789115501.876653:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:3.0:1789115501.876664:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedb38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288311936:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789115501.876723:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000597d4772/0xa47abda6516d3718 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.876745:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d36fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be2 expref: 7 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.876756:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789115501.876772:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789115501.876776:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000597d4772/0xa47abda6516d3718 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.876818:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d36fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be2 expref: 7 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.876833:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d36fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be2 expref: 7 pid: 6885 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115501.876849:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf52d2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1876023308261120:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115501.876933:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc62d4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789115501.883017:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115501.883115:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf52d2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1876023308261120:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789115501.883141:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000597d4772/0xa47abda6516d3718 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115501.883195:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288312064 00000100:00100000:0.0:1789115501.883201:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288312064 00010000:00010000:0.0:1789115501.883248:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d36fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be2 expref: 8 pid: 6885 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115501.883291:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1789115501.883300:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288312064:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115501.883316:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115501.883338:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d36fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be2 expref: 8 pid: 6885 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.883350:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d36fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be2 expref: 8 pid: 6885 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.883429:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d36fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be2 expref: 8 pid: 6885 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.883444:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789115501.883449:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789115501.883454:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000597d4772/0xa47abda6516d3718 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.883463:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000597d4772/0xa47abda6516d3718 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.883487:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115501.883534:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288312064:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 234us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115501.883542:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00010000:00010000:1.0:1789115501.883850:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000597d4772/0xa47abda6516d3718 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.883860:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000597d4772/0xa47abda6516d3718 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.883892:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000597d4772/0xa47abda6516d3718 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.883899:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000597d4772/0xa47abda6516d3718 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.883906:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000597d4772/0xa47abda6516d3718 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.883913:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea400 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115501.883916:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000597d4772/0xa47abda6516d3718 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.883924:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000597d4772/0xa47abda6516d3718 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.883934:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000597d4772/0xa47abda6516d3718 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.883941:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000597d4772/0xa47abda6516d3718 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115501.883996:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedb38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288311936:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 7334us (7632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115501.884003:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:0.0:1789115501.903098:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115501.903464:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288312320 00000100:00100000:0.0:1789115501.903474:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288312320 00000100:00100000:0.0:1789115501.903531:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:0.0:1789115501.903541:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+12:10648:x1876023288312320:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789115501.903623:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d371f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.903641:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d371f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.903669:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d371f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.903917:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.903927:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d36d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bcd expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.903934:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.903963:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d36d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bcd expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.903977:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d36d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bcd expref: 13 pid: 5852 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115501.903990:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfceda9f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308261248:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115501.904064:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789115501.916369:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfceda9f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308261248:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789115501.916458:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115501.919453:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115501.922947:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288312448 00000100:00100000:0.0:1789115501.922960:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288312448 00010000:00010000:0.0:1789115501.922999:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d36d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bcd expref: 14 pid: 5852 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115501.923057:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:0.0:1789115501.923067:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaada580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+14:2352:x1876023288312448:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115501.923082:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115501.923095:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d36d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bcd expref: 14 pid: 5852 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.923108:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d36d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bcd expref: 14 pid: 5852 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.923130:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d36d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bcd expref: 14 pid: 5852 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.923144:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:0.0:1789115501.923149:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.923159:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.923166:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.923193:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789115501.923803:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.923813:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789115501.924029:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1789115501.924191:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000100:00100000:0.0:1789115501.925569:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaada580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+15:2352:x1876023288312448:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 2493us (6203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115501.925581:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000001:00080000:3.0:1789115501.927659:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1789115501.927803:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf52d2940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1876023308261376:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789115501.927861:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115501.927900:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc62d4480 going to sleep for 11 seconds 00000100:00100000:0.0:1789115501.928562:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308261376 00000100:00100000:0.0:1789115501.928573:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308261376 00000100:00100000:0.0:1789115501.929541:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789115501.929555:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1876023308261376:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789115501.929659:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1876023308261376:12345-0@lo:1000:mdt00_000.0 Request processed in 108us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115501.929677:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789115501.929940:0:5850:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789115501.929946:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dfcf4c25a40, transno 4294967303 00000100:00100000:3.0:1789115501.929960:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf52d2940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1876023308261376:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789115501.932850:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789115501.932947:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf52d2940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1876023308261504:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789115501.933013:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115501.933060:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc62d4780 going to sleep for 11 seconds 00000100:00100000:0.0:1789115501.933342:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308261504 00000100:00100000:0.0:1789115501.933351:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308261504 00000100:00100000:2.0:1789115501.933582:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789115501.933593:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876023308261504:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789115501.933816:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1876023308261504:12345-0@lo:1000:mdt00_000.0 Request processed in 225us (801us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789115501.933824:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789115501.933995:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf52d2940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1876023308261504:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789115501.934032:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934043:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934049:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934054:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95dc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115501.934058:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934065:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934080:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:3.0:1789115501.934093:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789115501.934099:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934105:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3726 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934143:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3654 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934150:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3654 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934156:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3654 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934161:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115501.934163:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3654 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934169:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3654 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934177:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae500) 00010000:00010000:3.0:1789115501.934180:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789115501.934183:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3654 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934189:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3654 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934798:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934824:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3670 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bb1 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934834:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934868:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bb1 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115501.934883:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3670 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bb1 expref: 16 pid: 5850 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115501.934896:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf52d3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308261632:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115501.935003:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc62d4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789115501.946885:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115501.946976:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf52d3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308261632:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115501.947001:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115501.947545:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288312576 00000100:00100000:2.0:1789115501.947553:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288312576 00010000:00010000:2.0:1789115501.947591:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3670 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bb1 expref: 17 pid: 5850 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115501.947628:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:2.0:1789115501.947637:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+17:2352:x1876023288312576:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115501.947652:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115501.947658:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3670 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bb1 expref: 17 pid: 5850 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.947670:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bb1 expref: 17 pid: 5850 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.947701:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3670 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bb1 expref: 17 pid: 5850 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.947729:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae500) 00010000:00010000:2.0:1789115501.947734:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.947742:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.947749:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.947778:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115501.947831:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+16:2352:x1876023288312576:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 195us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115501.947839:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00010000:00010000:0.0:1789115501.947977:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.947984:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.947997:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.948004:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.948010:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.948016:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115501.948021:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.948028:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.948037:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae500) 00010000:00010000:0.0:1789115501.948039:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115501.948050:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.948057:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d372d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.948068:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d371f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.948074:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d371f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.948079:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d371f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.948083:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95c600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115501.948102:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d371f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.948108:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d371f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.948116:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae500) 00010000:00010000:0.0:1789115501.948118:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789115501.948120:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d371f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115501.948125:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d371f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115501.948356:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+15:10648:x1876023288312320:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 44816us (45268us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1789115501.948375:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00000020:00080000:0.0:1789115501.948419:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789115501.949039:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789115501.949044:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789115501.949072:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789115501.949078:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789115501.955583:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115501.955659:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288312832 00000100:00100000:1.0:1789115501.955668:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288312832 00000100:00100000:1.0:1789115501.955725:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1789115501.955736:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+15:10648:x1876023288312832:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789115501.956476:0:5853:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789115501.956587:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1789115501.956638:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3734 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.956656:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3734 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.956668:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3734 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.956677:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3734 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.956684:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3734 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.956690:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3734 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115501.956712:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789115501.956807:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+17:10648:x1876023288312832:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 1071us (1232us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789115501.956816:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000020:00080000:1.0:1789115501.956822:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789115501.957018:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789115501.957025:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3734 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.957032:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7200 already unused, calling callback (ffffffffc1728550) 00010000:00010000:2.0:1789115501.957036:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3734 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.957044:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3734 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.957068:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dfcd01ae000) 00010000:00010000:2.0:1789115501.957071:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789115501.957076:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3734 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.957082:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3734 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115501.957096:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115501.957098:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115501.957100:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115502.307902:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789115503.015467:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789115503.015483:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789115503.015531:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789115503.015538:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789115503.077788:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115503.077827:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115503.077857:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115503.077881:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115503.077904:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288313216 00000100:00100000:3.0:1789115503.077913:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288313216 00000100:00100000:1.0:1789115503.077949:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288312960 00000100:00100000:1.0:1789115503.077953:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288312960 00000100:00100000:3.0:1789115503.077974:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:1.0:1789115503.077980:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 316 00000100:00100000:3.0:1789115503.077983:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288313216:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115503.077986:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2353:x1876023288312960:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115503.078047:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2353:x1876023288312960:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 61us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115503.078049:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288313088 00000100:00100000:1.0:1789115503.078054:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 316 00000100:00100000:2.0:1789115503.078062:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288313088 00000100:00100000:1.0:1789115503.078082:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288313472 00000100:00100000:1.0:1789115503.078085:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288313472 00000100:00100000:2.0:1789115503.078094:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:2.0:1789115503.078100:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+17:2352:x1876023288313088:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115503.078107:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:1.0:1789115503.078113:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288313472:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115503.078155:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288313216:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 169us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115503.078170:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00080000:3.0:1789115503.078303:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789115503.078308:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789115503.078841:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+17:2352:x1876023288313088:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 738us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115503.078849:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:1.0:1789115503.079131:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288313472:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 1016us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115503.079138:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:3.0:1789115503.081501:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115503.081781:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288313344 00000100:00100000:0.0:1789115503.081796:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288313344 00000100:00100000:0.0:1789115503.081901:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:0.0:1789115503.081914:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288313344:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115503.082025:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288313344:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 114us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115503.082034:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00080000:3.0:1789115503.082165:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789115503.267845:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789115503.267867:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf5184b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308261760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789115503.267930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115503.267993:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308261760 00000100:00100000:3.0:1789115503.268000:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308261760 00000100:00100000:3.0:1789115503.268058:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789115503.268067:0:6701:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789115503.268074:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876023308261760:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789115503.268081:0:6701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1789115503.268108:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115503.268148:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876023308261760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115503.268156:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1789115503.268179:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789115503.268263:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf5184b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308261760:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789115503.332362:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789115503.594048:0:12439:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789115503.594056:0:12439:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789115503.594094:0:12439:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789115503.594100:0:12439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789115503.754873:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115503.755795:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288313728 00000100:00100000:1.0:1789115503.755806:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288313728 00000100:00100000:1.0:1789115503.755868:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:1.0:1789115503.755879:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+17:10667:x1876023288313728:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115503.755900:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115503.755919:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d373b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3be9 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.756331:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d3742 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.756358:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d3742 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.756371:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d3742 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115503.756421:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1789115503.756602:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d373b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be9 expref: 20 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.756620:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d3742 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be9 expref: 19 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.756629:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115503.756632:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789115503.756635:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7e00, rc 0) 00000100:00100000:1.0:1789115503.756714:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+19:10667:x1876023288313728:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 836us (1850us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1789115503.756722:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:2.0:1789115503.760127:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115503.760376:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288313856 00000100:00100000:1.0:1789115503.760413:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288313856 00000100:00100000:1.0:1789115503.760473:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:1.0:1789115503.760483:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+19:10667:x1876023288313856:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:1.0:1789115503.760556:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3750 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.760574:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3750 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.760605:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3750 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.760622:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3757 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.760629:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.760635:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761207:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d375e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761218:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d375e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761226:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d375e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789115503.761268:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d375e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761282:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3750 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761289:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3750 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761297:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3750 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761315:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115503.761319:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3750 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761328:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3750 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761342:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115503.761344:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115503.761348:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3750 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761354:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3750 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761366:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761371:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3757 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761376:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3757 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761445:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115503.761448:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3757 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761455:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3757 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761472:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcd01aee00) 00010000:00010000:1.0:1789115503.761474:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115503.761478:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3757 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761484:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3757 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761498:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d375e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761503:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d375e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761509:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d375e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761514:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115503.761516:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d375e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761522:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d375e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761528:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01ae900) 00010000:00010000:1.0:1789115503.761530:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115503.761532:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d375e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.761537:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d375e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115503.761661:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+19:10667:x1876023288313856:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 1176us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115503.761670:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:2.0:1789115503.826012:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115503.826122:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288314112 00000100:00100000:0.0:1789115503.826131:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288314112 00000100:00100000:0.0:1789115503.826187:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:0.0:1789115503.826212:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff912940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+19:10670:x1876023288314112:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115503.826231:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115503.826252:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d3765 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3bf0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826323:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c000/0xa47abda6516d376c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826337:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c000/0xa47abda6516d376c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826364:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c000/0xa47abda6516d376c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826403:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3773 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826411:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826418:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826713:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d377a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826723:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d377a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826730:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d377a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115503.826740:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789115503.826836:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c000/0xa47abda6516d376c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826844:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c000/0xa47abda6516d376c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826852:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c000/0xa47abda6516d376c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826858:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95c000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115503.826867:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c000/0xa47abda6516d376c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826876:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c000/0xa47abda6516d376c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826887:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:0.0:1789115503.826890:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115503.826895:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c000/0xa47abda6516d376c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826901:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c000/0xa47abda6516d376c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826913:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826919:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3773 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826926:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826931:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95dc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115503.826934:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826940:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3773 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826947:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcd044f800) 00010000:00010000:0.0:1789115503.826950:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115503.826957:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3773 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.826963:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95dc00/0xa47abda6516d3773 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.827004:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d3765 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf0 expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.827018:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d377a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf0 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.827026:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:0.0:1789115503.827028:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115503.827030:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e000, rc 0) 00000100:00100000:0.0:1789115503.827086:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff912940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+21:10670:x1876023288314112:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 891us (1083us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789115503.827094:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:0.0:1789115503.834268:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115503.834304:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288314240 00000100:00100000:0.0:1789115503.834312:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288314240 00000100:00100000:0.0:1789115503.834410:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:0.0:1789115503.834421:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+21:10670:x1876023288314240:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:0.0:1789115503.834489:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3788 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.834506:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.834518:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.834556:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.834563:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3788 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.834570:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.834576:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115503.834581:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.834587:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3788 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.834600:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:0.0:1789115503.834603:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789115503.834623:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3788 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115503.834631:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3788 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115503.834694:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+21:10670:x1876023288314240:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 275us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115503.834703:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:0.0:1789115503.842537:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115503.842571:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288314496 00000100:00100000:0.0:1789115503.842580:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288314496 00000100:00100000:0.0:1789115503.842638:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1789115503.842648:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd8a4f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+21:10670:x1876023288314496:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1789115503.842877:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd8a4f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+22:10670:x1876023288314496:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 229us (348us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789115503.842885:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000001:00080000:0.0:1789115503.869513:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:0.0:1789115503.869530:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:0.0:1789115503.869541:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1789115503.892377:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115503.892522:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288314752 00000100:00100000:1.0:1789115503.892532:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288314752 00000100:00100000:1.0:1789115503.892591:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:1.0:1789115503.892602:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+22:10190:x1876023288314752:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1789115503.892627:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115503.892648:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d378f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3bf7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.892743:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.892757:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d377a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf0 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.892765:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.892799:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d377a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf0 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.892813:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d377a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf0 expref: 23 pid: 5852 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115503.892827:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf5184f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876023308261888:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115503.892926:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd3e37f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115503.900701:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115503.900755:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288314880 00000100:00100000:3.0:1789115503.900764:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288314880 00010000:00010000:3.0:1789115503.900806:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d377a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf0 expref: 24 pid: 5852 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115503.900841:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:3.0:1789115503.900850:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+24:2352:x1876023288314880:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115503.900864:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115503.900881:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d377a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf0 expref: 24 pid: 5852 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115503.900893:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d377a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf0 expref: 24 pid: 5852 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115503.900914:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:3.0:1789115503.900919:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115503.900927:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115503.900934:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115503.900954:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115503.901012:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+24:2352:x1876023288314880:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 163us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115503.901021:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00010000:00010000:1.0:1789115503.901029:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d377a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf0 expref: 24 pid: 5852 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115503.901048:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf5184f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876023308261888:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115503.901065:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.901074:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.901080:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115503.901640:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789115503.901840:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d378f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf7 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.901857:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf7 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.901866:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:1.0:1789115503.901869:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789115503.901872:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6400, rc 0) 00000100:00100000:1.0:1789115503.901950:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+23:10190:x1876023288314752:12345-192.168.203.31@tcp:101:bash.0 Request processed in 9350us (9582us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789115503.901957:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:0.0:1789115503.918284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115503.918632:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288315136 00000100:00100000:2.0:1789115503.918642:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288315136 00000100:00100000:2.0:1789115503.918708:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:2.0:1789115503.918718:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+23:10190:x1876023288315136:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:2.0:1789115503.918970:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115503.919004:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115503.919015:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789115503.919067:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789115503.919091:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008d3a8f64 reply state 00000000cc1632c5 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115503.919100:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789115503.919146:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789115503.919256:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+27:10190:x1876023288315136:12345-192.168.203.31@tcp:36:bash.0 Request processed in 538us (981us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789115503.919264:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 89 00000020:00080000:2.0:1789115503.919268:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1789115503.922051:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115503.922067:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115503.922074:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115503.922081:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115503.922085:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115503.922093:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115503.922126:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:2.0:1789115503.922129:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115503.922135:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115503.922141:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115503.925821:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115503.926235:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288315264 00000100:00100000:1.0:1789115503.926262:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288315264 00000100:00100000:1.0:1789115503.926321:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:1.0:1789115503.926331:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+26:10190:x1876023288315264:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1789115503.926357:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115503.926377:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d37ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3bfe expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.926814:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d37ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bfe expref: 27 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.926830:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d37ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bfe expref: 27 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115503.926850:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:1.0:1789115503.926853:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789115503.926856:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6800, rc 0) 00000100:00100000:1.0:1789115503.926953:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+27:10190:x1876023288315264:12345-192.168.203.31@tcp:101:bash.0 Request processed in 622us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115503.926960:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:0.0:1789115503.942981:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115503.943149:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288315392 00000100:00100000:3.0:1789115503.943159:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288315392 00000100:00100000:3.0:1789115503.943229:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:3.0:1789115503.943240:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:10190:x1876023288315392:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1789115503.943258:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115503.943278:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bab43620/0xa47abda6516d37b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c05 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789115503.943305:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3bc6b, atime: 0x6aa3bc69, ctime: 0x6aa3bc6b, blocks: 0xb 00010000:00010000:3.0:1789115503.943340:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1789115503.943345:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115503.943354:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bab43620/0xa47abda6516d37b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c05 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115503.943377:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bab43620/0xa47abda6516d37b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c05 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115503.943422:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb400, rc 0) 00000100:00100000:3.0:1789115503.943490:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:10190:x1876023288315392:12345-192.168.203.31@tcp:101:bash.0 Request processed in 251us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115503.943497:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:3.0:1789115503.946265:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115503.946355:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288315520 00000100:00100000:0.0:1789115503.946365:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288315520 00002000:00010000:1.0:1789115503.946630:0:6702:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789115503.946636:0:6702:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcf52d0f00 with x1876023288315520 ext(0->18446744073709551615) 00002000:00010000:1.0:1789115503.946648:0:6702:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfcf52d0f00. 00000100:00100000:1.0:1789115503.946687:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1789115503.946698:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288315520:12345-192.168.203.31@tcp:10:bash.0 00002000:00010000:1.0:1789115503.946985:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789115503.946989:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789115499 -> 1789115503 00002000:00010000:1.0:1789115503.946992:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789115497 -> 1789115497 00002000:00010000:1.0:1789115503.947004:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789115499 -> 1789115503 00002000:00010000:1.0:1789115503.947007:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789115503.947112:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288315520:12345-192.168.203.31@tcp:10:bash.0 Request processed in 415us (854us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789115503.947121:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00002000:00010000:1.0:1789115503.947125:0:6702:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789115503.947128:0:6702:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcf52d0f00 with x1876023288315520 ext(0->18446744073709551615) 00002000:00010000:1.0:1789115503.947133:0:6702:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfcf52d0f00. 00000100:00100000:1.0:1789115504.024117:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115504.024227:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288315648 00000100:00100000:2.0:1789115504.024236:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288315648 00000100:00100000:2.0:1789115504.024297:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:2.0:1789115504.024307:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5184f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+27:10684:x1876023288315648:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:2.0:1789115504.024412:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024431:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024442:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024467:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024474:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024479:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024764:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d37c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024780:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d37c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024787:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d37c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789115504.024823:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d37c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024833:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024839:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024845:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024851:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115504.024855:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024862:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024873:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:2.0:1789115504.024875:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115504.024880:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024885:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d37b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024907:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024913:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024918:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024922:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacd200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115504.024925:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024931:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024939:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcc5118500) 00010000:00010000:2.0:1789115504.024941:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115504.024944:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024949:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024961:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d37c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024967:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d37c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024971:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d37c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024983:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacca00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115504.024986:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d37c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024991:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d37c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.024998:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:2.0:1789115504.025000:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115504.025002:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d37c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.025007:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d37c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115504.025089:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5184f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+27:10684:x1876023288315648:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 782us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115504.025099:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:3.0:1789115504.070332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115504.070566:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288315904 00000100:00100000:0.0:1789115504.070576:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288315904 00000100:00100000:0.0:1789115504.070638:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:0.0:1789115504.070648:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+27:10687:x1876023288315904:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115504.070682:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115504.070704:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d37ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c0c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.070775:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d37d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.070791:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d37d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.070831:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d37d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.070848:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.070855:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.070862:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071186:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d37e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071207:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d37e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071215:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d37e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115504.071226:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789115504.071317:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d37d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071324:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d37d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071331:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d37d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071336:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115504.071346:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d37d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071354:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d37d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071366:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:0.0:1789115504.071370:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115504.071374:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d37d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071662:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d37d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071955:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071963:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071970:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071975:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ea00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115504.071979:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071985:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.071994:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcd044f800) 00010000:00010000:0.0:1789115504.071997:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115504.072009:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.072015:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.072221:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d37ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c0c expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.072238:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d37e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c0c expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.072246:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:0.0:1789115504.072248:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789115504.072251:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e000, rc 0) 00000100:00100000:0.0:1789115504.072324:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+29:10687:x1876023288315904:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1677us (2000us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1789115504.072332:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:3.0:1789115504.077588:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115504.082213:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288316032 00000100:00100000:2.0:1789115504.082227:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288316032 00000100:00100000:2.0:1789115504.082290:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:2.0:1789115504.082301:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+29:10687:x1876023288316032:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1789115504.082368:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.082410:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf7 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.082421:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.082469:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf7 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.082483:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf7 expref: 29 pid: 5852 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115504.082497:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff912580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308262016:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115504.082593:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc5d779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115504.090740:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff912580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308262016:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115504.090771:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115504.097915:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115504.100523:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288316288 00000100:00100000:0.0:1789115504.100536:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288316288 00000100:00100000:0.0:1789115504.100613:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1789115504.100624:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+30:5591:x1876023288316288:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789115504.100988:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+31:5591:x1876023288316288:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 365us (3082us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789115504.101014:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1789115504.105616:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115504.106353:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288316416 00000100:00100000:0.0:1789115504.106364:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288316416 00010000:00010000:0.0:1789115504.106460:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf7 expref: 31 pid: 5852 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115504.106503:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:0.0:1789115504.106513:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff912580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+31:2352:x1876023288316416:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115504.106527:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115504.106535:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf7 expref: 31 pid: 5852 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.106548:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf7 expref: 31 pid: 5852 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.106572:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3796 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bf7 expref: 31 pid: 5852 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.106589:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:0.0:1789115504.106594:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.106604:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.106612:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.106661:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115504.106720:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff912580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+30:2352:x1876023288316416:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 208us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115504.106728:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00010000:00010000:2.0:1789115504.107333:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.107342:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.107373:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.107407:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.107414:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.107420:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacd200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115504.107424:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.107431:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.107451:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:2.0:1789115504.107454:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789115504.107458:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.107464:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d37f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115504.107532:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+29:10687:x1876023288316032:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 25231us (29951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115504.107540:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:2.0:1789115504.111030:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115504.111106:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288316672 00000100:00100000:0.0:1789115504.111116:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288316672 00000100:00100000:0.0:1789115504.111240:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:0.0:1789115504.111252:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+29:10687:x1876023288316672:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1789115504.111529:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+30:10687:x1876023288316672:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 279us (508us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789115504.111537:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1789115504.221010:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115504.221187:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288316928 00000100:00100000:0.0:1789115504.221211:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288316928 00000100:00100000:0.0:1789115504.221269:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:0.0:1789115504.221279:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+30:10698:x1876023288316928:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:0.0:1789115504.221302:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115504.221321:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d37f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c13 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.221433:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.221447:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.221457:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.221489:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3806 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.221496:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.221503:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.221830:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d380d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.221840:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d380d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.221847:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d380d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115504.221857:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1789115504.221943:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.221951:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.221957:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.221964:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ea00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115504.221968:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.221985:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.221997:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:0.0:1789115504.222000:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115504.222005:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.222011:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d37ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.222023:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.222027:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3806 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.222033:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.222038:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115504.222040:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.222046:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3806 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.222053:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcd044f800) 00010000:00010000:0.0:1789115504.222056:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115504.222059:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3806 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.222075:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3806 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.222120:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d37f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c13 expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.222133:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d380d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c13 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.222140:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:0.0:1789115504.222142:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115504.222145:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcda95c600, rc 0) 00000100:00100000:0.0:1789115504.222207:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+32:10698:x1876023288316928:12345-192.168.203.31@tcp:101:cat.0 Request processed in 930us (1208us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789115504.222215:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:2.0:1789115504.226840:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115504.226934:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288317184 00000100:00100000:3.0:1789115504.226942:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288317184 00000100:00100000:3.0:1789115504.226998:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:3.0:1789115504.227009:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+32:10698:x1876023288317184:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:3.0:1789115504.227243:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+33:10698:x1876023288317184:12345-192.168.203.31@tcp:35:cat.0 Request processed in 236us (411us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789115504.227252:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:2.0:1789115504.241170:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115504.241282:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288317440 00000100:00100000:1.0:1789115504.241292:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288317440 00000100:00100000:1.0:1789115504.241350:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:1.0:1789115504.241361:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+33:10699:x1876023288317440:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:1.0:1789115504.241446:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789115504.241474:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d380d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c13 expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.241496:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d37e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c0c expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.241510:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d37ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3bfe expref: 31 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.241520:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:1.0:1789115504.241532:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789115504.241551:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d381b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.241578:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d381b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.241589:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d381b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.241605:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3822 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.241612:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.241619:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.241924:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3829 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.241933:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.241941:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789115504.242604:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1789115504.242614:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321455231248ns, next at 322455229240ns, rc = 0 00010000:00010000:1.0:1789115504.242670:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3830 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242681:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242698:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242706:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3830 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242712:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3830 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242719:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3830 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242746:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789115504.242767:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242774:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3829 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242780:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3829 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242785:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115504.242789:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3829 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242796:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3829 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242805:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01aee00) 00010000:00010000:1.0:1789115504.242808:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789115504.242819:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3829 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242825:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3829 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242843:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d381b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242849:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d381b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242854:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d381b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242859:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115504.242862:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d381b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242868:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d381b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242876:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115504.242878:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115504.242881:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d381b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.242887:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d381b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789115504.242897:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001c9264f9 reply state 00000000762e41d1 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115504.242915:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789115504.243002:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+32:10699:x1876023288317440:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1640us (1837us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789115504.243012:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00010000:00010000:3.0:1789115504.243920:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115504.243929:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3830 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.243952:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115504.243956:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3830 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.243962:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3830 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.243974:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dfcd01aee00) 00010000:00010000:3.0:1789115504.243977:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789115504.243981:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3830 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.243987:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3830 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.244009:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115504.244011:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115504.244012:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115504.248638:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.248658:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3822 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.248666:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3822 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.248681:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115504.248686:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3822 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.248694:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3822 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.248725:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcd01ae900) 00010000:00010000:0.0:1789115504.248728:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115504.248734:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3822 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.248740:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3822 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115504.291824:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308262400:0@lo:400:kworker.0 00000100:00100000:2.0:1789115504.291892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115504.291952:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789115504.291958:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308262272:0@lo:400:kworker.0 00000100:00100000:2.0:1789115504.291980:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115504.291996:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308262784:0@lo:400:kworker.0 00000100:00100000:2.0:1789115504.292019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115504.292058:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308262784 00000100:00100000:2.0:1789115504.292065:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308262784 00000100:00100000:2.0:1789115504.292129:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789115504.292139:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308262784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115504.292188:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308262784:12345-0@lo:400:kworker.0 Request processed in 51us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115504.292460:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308262400 00000100:00100000:0.0:1789115504.292465:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308262400 00000100:00100000:0.0:1789115504.292494:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308262272 00000100:00100000:0.0:1789115504.292497:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308262272 00000100:00100000:0.0:1789115504.292515:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789115504.292522:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308262400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115504.292560:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308262400:12345-0@lo:400:kworker.0 Request processed in 39us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115504.292567:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789115504.292583:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789115504.292588:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308262272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115504.292613:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308262272:12345-0@lo:400:kworker.0 Request processed in 25us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115504.292619:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789115504.292661:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308262272:0@lo:400:kworker.0 00000100:00100000:0.0:1789115504.292686:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308262784:0@lo:400:kworker.0 00000100:00100000:0.0:1789115504.292697:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308262400:0@lo:400:kworker.0 00000100:00100000:1.0:1789115504.292843:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308262528:0@lo:400:kworker.0 00000100:00100000:1.0:1789115504.292877:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115504.292913:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789115504.292919:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308262144:0@lo:400:kworker.0 00000100:00100000:1.0:1789115504.292946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115504.292968:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308262656:0@lo:400:kworker.0 00000100:00100000:1.0:1789115504.292988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115504.293013:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308262656 00000100:00100000:1.0:1789115504.293017:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308262656 00000100:00100000:1.0:1789115504.293045:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789115504.293051:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf51870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308262656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115504.293097:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf51870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308262656:12345-0@lo:400:kworker.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115504.293104:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789115504.293123:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308262528 00000100:00100000:1.0:1789115504.293126:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308262528 00000100:00100000:1.0:1789115504.293149:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789115504.293155:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5187c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308262528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115504.293183:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5187c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308262528:12345-0@lo:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115504.293189:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789115504.293247:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308262656:0@lo:400:kworker.0 00000100:00100000:1.0:1789115504.293256:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789115504.293261:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1789115504.293275:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dfcf4c26d00, transno 4294967301 00000100:00100000:1.0:1789115504.293288:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308262528:0@lo:400:kworker.0 00000100:00100000:2.0:1789115504.293912:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789115504.293996:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789115504.294002:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789115504.294013:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308262144 00000100:00100000:3.0:1789115504.294019:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308262144 00000100:00100000:3.0:1789115504.294057:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789115504.294065:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308262144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115504.294130:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308262144:12345-0@lo:400:kworker.0 Request processed in 66us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115504.294136:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789115504.294562:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308262144:0@lo:400:kworker.0 00000100:00100000:2.0:1789115504.311326:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115504.311435:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288317696 00000100:00100000:1.0:1789115504.311446:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288317696 00000100:00100000:1.0:1789115504.311506:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:1.0:1789115504.311517:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff972940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+31:10705:x1876023288317696:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1789115504.311541:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115504.311561:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3837 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c1a expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.311792:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d383e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.311808:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d383e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.311819:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d383e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.313303:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3845 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.313319:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.313329:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789115504.314763:0:8213:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789115504.315047:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d384c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.317140:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d384c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.317157:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d384c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.317363:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d383e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.317372:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d383e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.317378:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d383e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.317401:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115504.317406:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d383e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.317413:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d383e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.317426:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115504.317429:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115504.317433:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d383e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.317459:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d383e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789115504.317476:0:8213:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000004d6c423 reply state 00000000d24f9f8b transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115504.317486:0:8213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789115504.317525:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3837 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c1a expref: 34 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.317540:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d384c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c1a expref: 33 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.317548:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd01ae900) 00010000:00010000:1.0:1789115504.317550:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115504.317553:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6400, rc 0) 00000100:00100000:1.0:1789115504.317634:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff972940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+34:10705:x1876023288317696:12345-192.168.203.31@tcp:101:bash.0 Request processed in 6118us (6316us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1789115504.317643:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00010000:00010000:2.0:1789115504.321955:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.321972:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3845 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.321979:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.321986:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115504.321991:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.321998:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3845 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.322015:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcd01ae200) 00010000:00010000:2.0:1789115504.322018:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115504.322022:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3845 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.322029:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3845 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115504.323275:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115504.323475:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288317824 00000100:00100000:1.0:1789115504.323485:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288317824 00000100:00100000:1.0:1789115504.323538:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1789115504.323548:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+5:2351:x1876023288317824:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1789115504.323565:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115504.323584:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8f62db9/0xa47abda6516d385a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c21 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789115504.323628:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789115504.323647:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1789115504.323651:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115504.323660:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8f62db9/0xa47abda6516d385a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c21 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.323688:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d8f62db9/0xa47abda6516d385a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c21 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.323702:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7600, rc 0) 00000100:00100000:1.0:1789115504.323757:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+6:2351:x1876023288317824:12345-192.168.203.31@tcp:101:bash.0 Request processed in 211us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115504.323763:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1789115504.331450:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115504.331603:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288317952 00000100:00100000:0.0:1789115504.331626:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288317952 00000100:00100000:0.0:1789115504.331733:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1789115504.331744:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf51861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:10705:x1876023288317952:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1789115504.331761:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115504.331780:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c28 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.331811:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8f62db9/0xa47abda6516d385a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c21 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.331820:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115504.331825:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115504.331831:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.331862:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8f62db9/0xa47abda6516d385a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c21 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.331875:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8f62db9/0xa47abda6516d385a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c21 expref: 7 pid: 6698 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115504.331889:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4ce4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6699:1876023308262912:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115504.331984:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a52b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789115504.338317:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115504.338533:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288318080 00000100:00100000:1.0:1789115504.338541:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288318080 00010000:00010000:1.0:1789115504.338579:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8f62db9/0xa47abda6516d385a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c21 expref: 8 pid: 6698 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115504.338619:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:1.0:1789115504.338629:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:2352:x1876023288318080:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115504.338644:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115504.338666:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8f62db9/0xa47abda6516d385a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c21 expref: 8 pid: 6698 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.338708:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8f62db9/0xa47abda6516d385a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c21 expref: 8 pid: 6698 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.338735:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115504.338741:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115504.338749:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.338758:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.338796:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115504.338810:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf5184b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1876023308263040:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789115504.338894:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd12419c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789115504.339452:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8f62db9/0xa47abda6516d385a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c21 expref: 8 pid: 6698 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115504.339480:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4ce4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6699:1876023308262912:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115504.339504:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.339514:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcda95dc00, rc 0) 00000100:00100000:0.0:1789115504.339560:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf51861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:10705:x1876023288317952:12345-192.168.203.31@tcp:101:bash.0 Request processed in 7819us (8120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115504.339568:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:3.0:1789115504.347484:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115504.347692:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf5184b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1876023308263040:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789115504.347716:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115504.347764:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288318080:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 9136us (9456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115504.347774:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:0.0:1789115504.348103:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288318336 00000100:00100000:0.0:1789115504.348111:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288318336 00000100:00100000:0.0:1789115504.348184:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1789115504.348202:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+33:10705:x1876023288318336:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:0.0:1789115504.348527:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+34:10705:x1876023288318336:12345-192.168.203.31@tcp:35:bash.0 Request processed in 334us (1052us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789115504.348535:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00010000:00010000:1.0:1789115504.355544:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115504.508340:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115504.510342:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288318464 00000100:00100000:1.0:1789115504.510356:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288318464 00000100:00100000:1.0:1789115504.510517:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:1.0:1789115504.510529:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+34:10721:x1876023288318464:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115504.510554:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115504.510575:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3868 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c2f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.510652:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d386f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.510666:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d386f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.510677:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d386f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115504.510733:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1789115504.510737:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115504.510761:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d386f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.510787:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3868 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c2f expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.510807:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d386f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c2f expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.510815:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115504.510818:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789115504.510822:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7400, rc 0) 00000100:00100000:1.0:1789115504.510896:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+35:10721:x1876023288318464:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 369us (2707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115504.510910:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:2.0:1789115504.521857:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115504.522189:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288318720 00000100:00100000:0.0:1789115504.522208:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288318720 00000100:00100000:0.0:1789115504.522268:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:0.0:1789115504.522278:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff970b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+35:10721:x1876023288318720:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115504.522297:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115504.522316:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c000/0xa47abda6516d3876 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c36 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.522440:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d387d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.522467:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d387d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.522479:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d387d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115504.522491:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789115504.522634:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c000/0xa47abda6516d3876 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c36 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.522653:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d387d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c36 expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.522663:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd01ae900) 00010000:00010000:0.0:1789115504.522665:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115504.522669:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcda95c600, rc 0) 00000100:00100000:0.0:1789115504.522733:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff970b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+37:10721:x1876023288318720:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 457us (886us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789115504.522740:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:2.0:1789115504.530213:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115504.530314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115504.530421:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288319104 00000100:00100000:1.0:1789115504.530431:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288319104 00000100:00100000:1.0:1789115504.530497:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:1.0:1789115504.530516:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+37:2352:x1876023288319104:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115504.530532:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115504.530558:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c600/0xa47abda6516d387d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c36 expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.530580:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd01ae900) 00010000:00010000:1.0:1789115504.530585:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115504.530650:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+36:2352:x1876023288319104:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 145us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115504.530658:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1789115504.532001:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288318976 00000100:00100000:0.0:1789115504.532012:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288318976 00000100:00100000:0.0:1789115504.532101:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:0.0:1789115504.532111:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff971680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+36:10721:x1876023288318976:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115504.532133:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115504.532152:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c000/0xa47abda6516d388b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c3d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.532273:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3892 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.532287:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.532300:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115504.532311:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789115504.532442:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcda95c000/0xa47abda6516d388b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c3d expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.532458:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3892 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c3d expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.532466:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd01ae900) 00010000:00010000:0.0:1789115504.532469:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789115504.532472:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e000, rc 0) 00000100:00100000:0.0:1789115504.532886:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff971680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+38:10721:x1876023288318976:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 775us (2688us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789115504.532895:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:2.0:1789115504.554838:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115504.555636:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288319232 00000100:00100000:1.0:1789115504.555646:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288319232 00000100:00100000:1.0:1789115504.555763:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:1.0:1789115504.555774:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+6:2351:x1876023288319232:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:1.0:1789115504.555817:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cce227cd/0xa47abda6516d38a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.555837:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.555845:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115504.555849:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789115504.555867:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cce227cd/0xa47abda6516d38a0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.555903:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.555917:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 6 pid: 6699 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115504.555932:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf5184b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1876023308263168:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115504.556154:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1241e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789115504.572283:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115504.572444:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf5184b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1876023308263168:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115504.572472:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cce227cd/0xa47abda6516d38a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115504.572640:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288319360 00000100:00100000:3.0:1789115504.572648:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288319360 00002000:00100000:3.0:1789115504.572702:0:6704:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8dfcc89a12c0 x1876023288319360/t0(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:320/0 lens 504/0 e 0 to 0 dl 1789115515 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789115504.572712:0:6704:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcc89a12c0 with x1876023288319360 ext(0->8) 00010000:00010000:3.0:1789115504.572720:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 7 pid: 6699 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.572734:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 7 pid: 6699 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789115504.572741:0:6704:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dfcc89a12c0 00000100:00100000:3.0:1789115504.572772:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:3.0:1789115504.572780:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2352:x1876023288319360:12345-192.168.203.31@tcp:4:lfs.0 00000100:00100000:3.0:1789115504.573489:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6dbf7574-92fb-4b89-af78-41319f924699+9:2352:x1876023288319360:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 704us (1212us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789115504.573498:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00002000:00100000:3.0:1789115504.573912:0:6704:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8dfcc89a12c0 x1876023288319360/t4294967302(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:320/0 lens 504/448 e 0 to 0 dl 1789115515 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789115504.573923:0:6704:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcc89a12c0 with x1876023288319360 ext(0->8) 00010000:00010000:3.0:1789115504.573932:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 9 pid: 6699 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.574378:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 9 pid: 6699 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789115504.574455:0:6704:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dfcc89a12c0 00000100:00100000:2.0:1789115504.596486:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115504.597530:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288319488 00000100:00100000:3.0:1789115504.597541:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288319488 00010000:00010000:3.0:1789115504.597585:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 9 pid: 6699 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115504.597642:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:3.0:1789115504.597653:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+9:2350:x1876023288319488:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115504.597669:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789115504.597700:0:6713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789115504.597703:0:6713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789115503 00002000:00010000:3.0:1789115504.597705:0:6713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789115503 00002000:00010000:3.0:1789115504.597707:0:6713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789115503 00010000:00010000:3.0:1789115504.597713:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 9 pid: 6699 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.597726:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 9 pid: 6699 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.597749:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017304852/0xa47abda6516d3861 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c28 expref: 9 pid: 6699 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.597777:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789115504.597781:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789115504.597787:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cce227cd/0xa47abda6516d38a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.597811:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cce227cd/0xa47abda6516d38a0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.597851:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115504.597914:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+8:2350:x1876023288319488:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 263us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115504.597922:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00010000:00010000:0.0:1789115504.598695:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cce227cd/0xa47abda6516d38a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.598709:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cce227cd/0xa47abda6516d38a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.598750:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cce227cd/0xa47abda6516d38a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.598767:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cce227cd/0xa47abda6516d38a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.598775:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cce227cd/0xa47abda6516d38a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.598783:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7200 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115504.598788:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cce227cd/0xa47abda6516d38a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.598797:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cce227cd/0xa47abda6516d38a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.598812:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cce227cd/0xa47abda6516d38a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.598819:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cce227cd/0xa47abda6516d38a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115504.598890:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+7:2351:x1876023288319232:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 43117us (44059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115504.598898:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1789115504.610096:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115504.610187:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288319744 00000100:00100000:1.0:1789115504.610207:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288319744 00000100:00100000:1.0:1789115504.610266:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:1.0:1789115504.610276:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd8a4e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+38:10721:x1876023288319744:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:1.0:1789115504.610334:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3892 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c3d expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789115504.610628:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789115504.610677:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789115504.610981:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789115504.611033:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.611059:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d384c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c1a expref: 42 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.611067:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.611100:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d384c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c1a expref: 42 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.611115:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d384c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c1a expref: 42 pid: 8213 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115504.611129:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf5184b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1876023308263296:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115504.611211:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1241e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789115504.623072:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf5184b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1876023308263296:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115504.623102:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115504.627755:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115504.627859:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288319872 00000100:00100000:1.0:1789115504.627869:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288319872 00010000:00010000:1.0:1789115504.627910:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d384c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c1a expref: 43 pid: 8213 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115504.627966:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:1.0:1789115504.627975:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+43:2353:x1876023288319872:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115504.627989:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115504.628011:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d384c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c1a expref: 43 pid: 8213 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.628023:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d384c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c1a expref: 43 pid: 8213 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.628046:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d384c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c1a expref: 43 pid: 8213 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.628062:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd01ae900) 00010000:00010000:1.0:1789115504.628066:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.628075:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.628082:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.628112:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115504.628166:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+42:2353:x1876023288319872:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 192us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115504.628174:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00010000:00010000:0.0:1789115504.628433:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.628441:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789115504.628566:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789115504.628759:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1789115504.628861:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4ce4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876023308263424:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789115504.628908:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115504.628947:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a523c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789115504.628999:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308263424 00000100:00100000:3.0:1789115504.629005:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308263424 00000100:00100000:3.0:1789115504.629042:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789115504.629050:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1876023308263424:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789115504.629303:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1876023308263424:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 253us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115504.629310:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789115504.629492:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4ce4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876023308263424:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789115504.629945:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789115504.630264:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf5184b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876023308263552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789115504.630305:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115504.630326:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcedbb1900 going to sleep for 11 seconds 00000100:00100000:2.0:1789115504.630410:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308263552 00000100:00100000:2.0:1789115504.630417:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308263552 00000100:00100000:2.0:1789115504.630458:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789115504.630466:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1876023308263552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789115504.630639:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1876023308263552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 174us (333us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789115504.630648:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789115504.631082:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf5184b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876023308263552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789115504.631144:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1789115504.631184:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.631205:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.631214:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.631219:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115504.631223:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.631231:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.631246:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd01ae900) 00010000:00010000:1.0:1789115504.631249:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789115504.631253:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.631259:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789115504.631442:0:5853:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789115504.631675:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1789115504.631687:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 321844304375ns, next at 322844301572ns, rc = 0 00000001:00080000:1.0:1789115504.631694:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1789115504.631729:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd01ae900) 00010000:00010000:1.0:1789115504.631733:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789115504.631746:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3892 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c3d expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115504.632895:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd8a4e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+45:10721:x1876023288319744:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 22613us (22801us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1789115504.632907:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000020:00080000:1.0:1789115504.632913:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789115504.638040:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115504.638153:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288320000 00000100:00100000:0.0:1789115504.638163:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288320000 00000100:00100000:0.0:1789115504.638224:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:0.0:1789115504.638233:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+45:10721:x1876023288320000:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115504.638260:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115504.638287:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d38ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c44 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.638347:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d38ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c44 expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.638361:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d38ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c44 expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.638378:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:0.0:1789115504.638417:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789115504.638421:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f600, rc 0) 00000100:00100000:0.0:1789115504.638466:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+46:10721:x1876023288320000:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 234us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115504.638484:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:3.0:1789115504.650179:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115504.650238:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288320256 00000100:00100000:0.0:1789115504.650248:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288320256 00000100:00100000:0.0:1789115504.650305:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1789115504.650315:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+46:10721:x1876023288320256:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1789115504.650583:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+47:10721:x1876023288320256:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 268us (412us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789115504.650591:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:2.0:1789115504.799675:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115504.799780:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288320384 00000100:00100000:1.0:1789115504.799789:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288320384 00000100:00100000:1.0:1789115504.799847:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:1.0:1789115504.799858:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+47:10731:x1876023288320384:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:1.0:1789115504.800122:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800139:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800164:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800179:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d38bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800187:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d38bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800203:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d38bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800293:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d38c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800317:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d38c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800324:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d38c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789115504.800363:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d38c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800373:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800407:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800414:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800419:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115504.800423:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800429:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800439:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115504.800442:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115504.800445:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800450:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d38b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800469:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d38bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800475:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d38bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800480:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d38bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800485:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115504.800488:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d38bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800495:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d38bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800501:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcd01ae900) 00010000:00010000:1.0:1789115504.800504:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115504.800507:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d38bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800512:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d38bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800525:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d38c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800531:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d38c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800537:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d38c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800547:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115504.800550:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d38c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800556:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d38c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800564:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:1.0:1789115504.800567:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115504.800570:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d38c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.800575:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d38c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115504.800652:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+47:10731:x1876023288320384:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 796us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115504.800661:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:2.0:1789115504.804117:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4ce4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308263680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789115504.804205:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115504.804413:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308263680 00000100:00100000:0.0:1789115504.804421:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308263680 00000100:00100000:0.0:1789115504.804466:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789115504.804475:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308263680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115504.804508:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115504.804553:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308263680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115504.804560:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789115504.804663:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4ce4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308263680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115504.860692:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115504.860845:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288320640 00000100:00100000:0.0:1789115504.860854:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288320640 00000100:00100000:0.0:1789115504.860916:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:0.0:1789115504.860927:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaada580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+47:10734:x1876023288320640:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115504.860947:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115504.860978:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d38ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861045:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d38d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861070:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d38d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861080:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d38d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861105:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d38d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861111:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d38d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861118:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d38d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861245:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d38df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861253:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d38df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861260:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d38df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115504.861270:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789115504.861370:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d38d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861378:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d38d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861412:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d38d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861424:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ea00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115504.861429:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d38d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861437:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d38d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861449:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:0.0:1789115504.861452:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115504.861457:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d38d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861463:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d38d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861476:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d38d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861482:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d38d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861487:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d38d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861493:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115504.861496:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d38d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861502:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d38d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861520:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcd044f200) 00010000:00010000:0.0:1789115504.861523:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115504.861526:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d38d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861532:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d38d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861571:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d38ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c4b expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861585:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d38df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c4b expref: 49 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.861592:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:0.0:1789115504.861595:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115504.861597:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c5e00, rc 0) 00000100:00100000:0.0:1789115504.861873:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaada580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+49:10734:x1876023288320640:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 948us (1188us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1789115504.861882:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:3.0:1789115504.865148:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115504.865299:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288320768 00000100:00100000:0.0:1789115504.865309:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288320768 00000100:00100000:0.0:1789115504.865375:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:0.0:1789115504.865405:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+49:10734:x1876023288320768:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:0.0:1789115504.865475:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d38ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.865491:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d38ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.865517:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d38ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.865544:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d38ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.865551:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d38ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.865557:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d38ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.865563:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c5400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115504.865567:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d38ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.865574:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d38ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.865585:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:0.0:1789115504.865588:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789115504.865593:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d38ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.865599:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d38ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115504.865887:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+49:10734:x1876023288320768:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 502us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115504.865896:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:2.0:1789115504.869279:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115504.869347:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288321024 00000100:00100000:0.0:1789115504.869366:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288321024 00000100:00100000:0.0:1789115504.869470:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:0.0:1789115504.869480:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+49:10734:x1876023288321024:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1789115504.869707:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+50:10734:x1876023288321024:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 228us (435us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789115504.869716:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:3.0:1789115504.956636:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115504.957503:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288321280 00000100:00100000:0.0:1789115504.957515:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288321280 00000100:00100000:0.0:1789115504.957579:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:0.0:1789115504.957589:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+50:10744:x1876023288321280:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1789115504.957613:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115504.957616:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789115504.957644:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d386f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c2f expref: 50 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.957665:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:0.0:1789115504.957670:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115504.957683:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d38f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c52 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.957786:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.957807:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d38df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c4b expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.957815:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.957865:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d38df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c4b expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.957879:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d38df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c4b expref: 50 pid: 5851 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115504.957891:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4ce7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308263808:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115504.958047:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a52780 going to sleep for 11 seconds 00000100:00100000:3.0:1789115504.965752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115504.965833:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288321408 00000100:00100000:1.0:1789115504.965842:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288321408 00010000:00010000:1.0:1789115504.965882:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d38df lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c4b expref: 51 pid: 5851 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115504.965924:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:1.0:1789115504.965933:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff912580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+51:2352:x1876023288321408:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115504.965948:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115504.965955:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d38df lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c4b expref: 51 pid: 5851 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.965988:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d38df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c4b expref: 51 pid: 5851 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.966012:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:1.0:1789115504.966017:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.966027:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.966035:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.966055:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115504.966120:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff912580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+51:2352:x1876023288321408:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 187us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115504.966128:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00010000:00010000:0.0:1789115504.966876:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d38df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c4b expref: 50 pid: 5851 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115504.966895:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4ce7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308263808:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115504.966917:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.967012:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.967019:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115504.967036:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789115504.972069:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d38f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c52 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.972103:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c52 expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.972138:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:1.0:1789115504.972141:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789115504.972145:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c4c00, rc 0) 00000100:00100000:1.0:1789115504.972224:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+50:10744:x1876023288321280:12345-192.168.203.31@tcp:101:bash.0 Request processed in 14634us (15595us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789115504.972233:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:3.0:1789115504.975030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115504.975690:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288321664 00000100:00100000:1.0:1789115504.975701:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288321664 00000100:00100000:1.0:1789115504.975912:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:1.0:1789115504.975934:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+50:10744:x1876023288321664:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:1.0:1789115504.976180:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3909 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.976209:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3909 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115504.976221:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3909 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789115504.976272:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1789115504.976301:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008501c2d3 reply state 00000000e354ff02 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3909 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115504.976310:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789115504.976417:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+53:10744:x1876023288321664:12345-192.168.203.31@tcp:36:bash.0 Request processed in 486us (1395us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789115504.985182:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115504.985226:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288321792 00000100:00100000:3.0:1789115504.985235:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288321792 00000100:00100000:3.0:1789115504.985285:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:3.0:1789115504.985294:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+54:10744:x1876023288321792:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1789115504.985333:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115504.985356:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d3910 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c59 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.985458:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.985473:0:8213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c52 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.985480:0:8213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3909 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.985488:0:8213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.985505:0:8213:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3909 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.985528:0:8213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c52 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115504.985542:0:8213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c52 expref: 55 pid: 5851 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115504.985554:0:8213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf52d1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308263936:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115504.985631:0:8213:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfc2d2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789115504.985882:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 105 00000020:00080000:1.0:1789115504.985896:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789115504.986940:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3909 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.986963:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3909 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.986970:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3909 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.986976:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115504.986981:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3909 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.987004:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3909 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.987020:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:0.0:1789115504.987023:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115504.987027:0:3291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.987037:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3909 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.987044:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3909 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115504.991592:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115504.991666:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288321920 00000100:00100000:2.0:1789115504.991674:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288321920 00010000:00010000:2.0:1789115504.991715:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c52 expref: 54 pid: 5851 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115504.991765:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:2.0:1789115504.991775:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8852940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+54:2353:x1876023288321920:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115504.991808:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115504.991815:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c52 expref: 54 pid: 5851 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.991829:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c52 expref: 54 pid: 5851 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.991852:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:2.0:1789115504.991857:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.991866:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.991873:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115504.991892:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115504.991939:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8852940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+54:2353:x1876023288321920:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 165us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115504.991947:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00010000:00010000:0.0:1789115504.992409:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d38fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c52 expref: 53 pid: 5851 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115504.992425:0:8213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf52d1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308263936:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115504.992446:0:8213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.992454:0:8213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.992460:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115504.992505:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789115504.992510:0:8213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115504.992529:0:8213:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.992567:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d3910 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c59 expref: 53 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.992582:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c59 expref: 52 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115504.992589:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:0.0:1789115504.992592:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115504.992595:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb000, rc 0) 00000100:00100000:0.0:1789115504.992638:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+52:10744:x1876023288321792:12345-192.168.203.31@tcp:101:bash.0 Request processed in 7345us (7465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115504.992646:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:3.0:1789115504.997848:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115504.998279:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288322176 00000100:00100000:2.0:1789115504.998288:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288322176 00000100:00100000:2.0:1789115504.998346:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:2.0:1789115504.998356:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+52:10744:x1876023288322176:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:2.0:1789115504.998600:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+53:10744:x1876023288322176:12345-192.168.203.31@tcp:35:bash.0 Request processed in 245us (762us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789115504.998608:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:2.0:1789115505.094029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115505.094158:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288322304 00000100:00100000:3.0:1789115505.094168:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288322304 00000100:00100000:3.0:1789115505.094254:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:3.0:1789115505.094264:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+53:10750:x1876023288322304:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789115505.094288:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115505.094308:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea400/0xa47abda6516d391e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c60 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115505.094372:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3925 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115505.094413:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115505.094425:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115505.094481:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1789115505.094484:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789115505.094506:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115505.094529:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea400/0xa47abda6516d391e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c60 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115505.094546:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3925 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c60 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115505.094554:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:3.0:1789115505.094558:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789115505.094573:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ebc00, rc 0) 00000100:00100000:3.0:1789115505.094629:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+54:10750:x1876023288322304:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 367us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115505.094637:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00080000:0.0:1789115505.094849:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115505.099131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115505.100315:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288322432 00000100:00100000:2.0:1789115505.100327:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288322432 00000100:00100000:2.0:1789115505.100413:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:2.0:1789115505.100423:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+54:10750:x1876023288322432:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789115505.100444:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115505.100465:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d392c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c67 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100531:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3933 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100546:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3933 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100557:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3933 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100572:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d393a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100578:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d393a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100584:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d393a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100697:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3941 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100706:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100727:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115505.100763:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789115505.100767:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789115505.100785:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100796:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100804:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3933 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100810:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3933 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100817:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3933 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100824:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacdc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115505.100827:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3933 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100836:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3933 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100847:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:2.0:1789115505.100850:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115505.100855:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3933 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100872:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3933 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100888:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d393a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100893:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d393a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100899:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d393a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100905:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115505.100908:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d393a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100914:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d393a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100922:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcc5118500) 00010000:00010000:2.0:1789115505.100925:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115505.100927:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d393a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100933:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d393a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100970:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d392c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c67 expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100983:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c67 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.100997:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:2.0:1789115505.100999:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789115505.101002:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacd200, rc 0) 00000100:00100000:2.0:1789115505.101129:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+55:10750:x1876023288322432:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 707us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115505.101137:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:3.0:1789115505.109998:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115505.110096:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115505.110173:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288322560 00000100:00100000:0.0:1789115505.110183:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288322560 00000100:00100000:0.0:1789115505.110260:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1789115505.110270:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8826d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+55:2353:x1876023288322560:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115505.110284:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115505.110309:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3941 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c67 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115505.110330:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:0.0:1789115505.110336:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115505.110522:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8826d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+54:2353:x1876023288322560:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 252us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115505.110530:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1789115505.112170:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288322816 00000100:00100000:1.0:1789115505.112182:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288322816 00000100:00100000:1.0:1789115505.112414:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:1.0:1789115505.112426:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8825a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+54:10750:x1876023288322816:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115505.112446:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115505.112465:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3948 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c6e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115505.112562:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115505.112577:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c59 expref: 55 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115505.112586:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115505.112619:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c59 expref: 55 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115505.112633:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c59 expref: 55 pid: 8213 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115505.112663:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd217e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308264064:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115505.112753:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc7315c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789115505.116570:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd217e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308264064:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115505.116597:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115505.117955:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115505.118231:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288322944 00000100:00100000:3.0:1789115505.118240:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288322944 00010000:00010000:3.0:1789115505.118279:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c59 expref: 56 pid: 8213 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115505.118323:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:3.0:1789115505.118333:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+56:2352:x1876023288322944:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115505.118348:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115505.118355:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c59 expref: 56 pid: 8213 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115505.118367:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c59 expref: 56 pid: 8213 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115505.118413:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3917 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c59 expref: 56 pid: 8213 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115505.118429:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:3.0:1789115505.118434:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115505.118460:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115505.118468:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115505.118500:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115505.118550:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+55:2352:x1876023288322944:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 218us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115505.118558:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00010000:00010000:2.0:1789115505.118664:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.118681:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115505.118703:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789115505.118853:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6400/0xa47abda6516d3948 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c6e expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.118870:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c6e expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.118876:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:2.0:1789115505.118879:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789115505.118881:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6c00, rc 0) 00000100:00100000:2.0:1789115505.118908:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8825a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+55:10750:x1876023288322816:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 6486us (8970us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789115505.118914:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:3.0:1789115505.123077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115505.123230:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288323200 00000100:00100000:0.0:1789115505.123240:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288323200 00000100:00100000:0.0:1789115505.123335:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1789115505.123345:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c26d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+55:10750:x1876023288323200:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:0.0:1789115505.123359:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115505.123421:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d38ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c44 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115505.123441:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:0.0:1789115505.123446:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115505.123496:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c26d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+54:10750:x1876023288323200:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 154us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115505.123503:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1789115505.130903:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115505.131046:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288323328 00000100:00100000:2.0:1789115505.131069:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288323328 00000100:00100000:2.0:1789115505.131138:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:2.0:1789115505.131148:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+54:10750:x1876023288323328:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:2.0:1789115505.131254:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d395d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.131271:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d395d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115505.131282:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d395d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789115505.131509:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789115505.131590:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+54:10750:x1876023288323328:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 443us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115505.131598:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:2.0:1789115505.135518:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115505.135619:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288323456 00000100:00100000:1.0:1789115505.135629:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288323456 00000100:00100000:1.0:1789115505.135696:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:1.0:1789115505.135706:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+54:10750:x1876023288323456:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115505.135726:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115505.135747:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3964 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c75 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115505.135813:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d395d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115505.135824:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3964 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c75 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115505.135842:0:5850:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d395d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115505.135855:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3964 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c75 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115505.135867:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:1.0:1789115505.135871:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789115505.135874:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3964 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c75 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115505.135882:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7600, rc 0) 00000100:00100000:1.0:1789115505.135936:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+55:10750:x1876023288323456:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 231us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115505.135960:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 111 00010000:00010000:2.0:1789115505.379697:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789115506.083652:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789115506.083661:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789115506.083707:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789115506.083715:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789115506.083838:0:12072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd217e580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876023308264192:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789115506.085133:0:12072:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc7315b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789115506.122724:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115506.122897:0:12072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd217e580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876023308264192:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789115506.124933:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288323584 00000100:00100000:0.0:1789115506.124947:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288323584 00000100:00100000:0.0:1789115506.125021:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:0.0:1789115506.125033:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+55:10751:x1876023288323584:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789115506.125063:0:5852:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789115506.125190:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+55:10751:x1876023288323584:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 150us (2806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115506.125198:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:3.0:1789115506.135507:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115506.135700:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288323712 00000100:00100000:1.0:1789115506.135713:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288323712 00000100:00100000:1.0:1789115506.135799:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:1.0:1789115506.135811:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+55:10751:x1876023288323712:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789115506.135909:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d396b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.135932:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d396b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.135950:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d396b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.141795:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3972 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.141826:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3972 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.141864:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3972 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.141908:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3979 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.141918:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.141924:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115506.141980:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789115506.141986:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115506.142004:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142016:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d396b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142023:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d396b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142031:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d396b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142038:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115506.142043:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d396b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142062:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d396b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142086:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:0.0:1789115506.142089:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115506.142095:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d396b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142102:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d396b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142121:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3972 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142128:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3972 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142134:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3972 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142139:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c4c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115506.142142:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3972 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142148:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3972 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142154:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8dfcd044f200) 00010000:00010000:0.0:1789115506.142156:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115506.142159:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3972 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142165:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3972 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142346:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142355:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3979 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142361:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3979 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142366:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c5e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115506.142370:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3979 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142377:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3979 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142451:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:0.0:1789115506.142454:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115506.142457:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3979 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.142464:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3979 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115506.142575:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+55:10751:x1876023288323712:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 6760us (7075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115506.142586:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:1.0:1789115506.152661:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115506.152754:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288323968 00000100:00100000:0.0:1789115506.152776:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288323968 00000100:00100000:0.0:1789115506.152854:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:0.0:1789115506.152885:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd217e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+55:10751:x1876023288323968:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115506.152916:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115506.152945:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3980 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c7c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.153076:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3987 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.153096:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.153110:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115506.153124:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789115506.153261:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.153269:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3987 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.153277:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.153283:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c5c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115506.153288:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.153296:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3987 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.153311:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:0.0:1789115506.153322:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789115506.153328:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3987 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.153335:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3987 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.153440:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3980 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c7c expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.153452:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:0.0:1789115506.153455:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789115506.153458:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3980 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c7c expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.153470:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c4c00, rc 0) 00000100:00100000:0.0:1789115506.153556:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd217e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+56:10751:x1876023288323968:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 673us (910us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1789115506.153564:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:2.0:1789115506.158357:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115506.158527:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288324096 00000100:00100000:1.0:1789115506.158541:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288324096 00000100:00100000:1.0:1789115506.158611:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:1.0:1789115506.158623:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+56:10751:x1876023288324096:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789115506.158674:0:5851:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789115506.158847:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+56:10751:x1876023288324096:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 224us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115506.158856:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:2.0:1789115506.169127:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115506.169945:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288324352 00000100:00100000:0.0:1789115506.169956:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288324352 00000100:00100000:0.0:1789115506.170032:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:0.0:1789115506.170043:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+56:10751:x1876023288324352:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115506.170063:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115506.170066:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789115506.170103:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3925 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c60 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.170123:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:0.0:1789115506.170141:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115506.170156:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3995 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c83 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789115506.170599:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789115506.172300:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d399c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.172320:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d399c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.172332:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d399c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.172412:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3995 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c83 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.172431:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d399c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c83 expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.172439:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dfcd044f200) 00010000:00010000:0.0:1789115506.172442:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115506.172445:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c5c00, rc 0) 00000100:00100000:0.0:1789115506.172520:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+57:10751:x1876023288324352:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 2478us (3403us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789115506.172529:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:2.0:1789115506.180558:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115506.180654:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288324608 00000100:00100000:1.0:1789115506.180671:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288324608 00000100:00100000:1.0:1789115506.180730:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:1.0:1789115506.180740:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+57:10751:x1876023288324608:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789115506.180798:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115506.180824:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d399c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c83 expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.180844:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dfcd044f200) 00010000:00010000:1.0:1789115506.180865:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789115506.180886:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d39aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.180900:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d39aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.180909:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d39aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.180924:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d39b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5231291e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.180931:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d39b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5231291e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.180938:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d39b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5231291e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.181042:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d39aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.181050:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d39aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.181056:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d39aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.181072:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115506.181077:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d39aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.181478:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d39aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.181490:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115506.181493:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115506.181499:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d39aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.181505:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d39aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.181516:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d39b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5231291e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.181521:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d39b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5231291e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.181527:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d39b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5231291e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.181540:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115506.181544:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d39b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5231291e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.181554:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d39b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5231291e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.181562:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5231291e (ffff8dfcd01ae900) 00010000:00010000:1.0:1789115506.181564:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115506.181567:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d39b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5231291e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.181573:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d39b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5231291e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115506.181818:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+56:10751:x1876023288324608:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1078us (1268us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789115506.181826:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:2.0:1789115506.188882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115506.189020:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288324736 00000100:00100000:3.0:1789115506.189029:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288324736 00000100:00100000:3.0:1789115506.189094:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:3.0:1789115506.189104:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+56:10751:x1876023288324736:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789115506.189124:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115506.189146:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d39b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c8a expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.189470:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d39bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.189485:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d39bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.189498:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d39bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.189610:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d39b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c8a expref: 58 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.189629:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d39bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c8a expref: 57 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.189638:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dfcf2157900) 00010000:00010000:3.0:1789115506.189641:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789115506.189643:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eac00, rc 0) 00000100:00100000:3.0:1789115506.189794:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+57:10751:x1876023288324736:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 691us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115506.189802:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:3.0:1789115506.201653:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115506.201790:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288324992 00000100:00100000:0.0:1789115506.201801:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288324992 00000100:00100000:0.0:1789115506.201898:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:0.0:1789115506.201908:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+57:10751:x1876023288324992:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789115506.202205:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d39c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.202221:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d39c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.202232:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d39c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789115506.202521:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1789115506.202531:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323415148833ns, next at 324415146129ns, rc = 0 00000004:00010000:0.0:1789115506.202616:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005a528193 reply state 00000000676c3f5d transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d39c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115506.202626:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789115506.203341:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+59:10751:x1876023288324992:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1430us (1693us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1789115506.203350:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:2.0:1789115506.217224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115506.218678:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288325120 00000100:00100000:0.0:1789115506.218690:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288325120 00000100:00100000:0.0:1789115506.218753:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:0.0:1789115506.218763:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+59:10751:x1876023288325120:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115506.218788:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115506.218808:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d39cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c91 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.218881:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d39cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c91 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.218917:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d39cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c91 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.218939:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dfcf2157900) 00010000:00010000:0.0:1789115506.218942:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789115506.218947:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c5e00, rc 0) 00000100:00100000:0.0:1789115506.219011:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+60:10751:x1876023288325120:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 249us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115506.219019:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:2.0:1789115506.222637:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115506.222779:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288325248 00000100:00100000:0.0:1789115506.222789:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288325248 00000100:00100000:0.0:1789115506.222868:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1789115506.222878:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288325248:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789115506.223099:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789115506.223648:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+9:2353:x1876023288325248:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 769us (1019us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789115506.223657:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00010000:00010000:1.0:1789115506.225295:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d39c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.225312:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d39c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.225320:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d39c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.225326:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c4c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115506.225331:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d39c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.225355:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d39c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.225372:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dfcf2157900) 00010000:00010000:1.0:1789115506.225375:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789115506.225379:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d39c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.225410:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d39c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115506.229169:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115506.229271:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288325504 00000100:00100000:1.0:1789115506.229281:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288325504 00000100:00100000:1.0:1789115506.229342:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:1.0:1789115506.229352:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+59:10751:x1876023288325504:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789115506.229600:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+60:10751:x1876023288325504:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 248us (438us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789115506.229609:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1789115506.233508:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115506.233612:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288325760 00000100:00100000:1.0:1789115506.233621:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288325760 00000100:00100000:1.0:1789115506.233779:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:1.0:1789115506.233791:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+60:10751:x1876023288325760:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789115506.233921:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+60:10751:x1876023288325760:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 132us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115506.233928:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:2.0:1789115506.236804:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115506.236934:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288325888 00000100:00100000:0.0:1789115506.236943:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288325888 00000100:00100000:0.0:1789115506.236993:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:0.0:1789115506.237003:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+60:10751:x1876023288325888:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115506.237022:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115506.237042:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d39d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c98 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.237127:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d39db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.237153:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d39db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.237164:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d39db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115506.237213:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115506.237232:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d39db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.237258:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d39d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c98 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.237275:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d39db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c98 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.237283:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dfcf2157900) 00010000:00010000:0.0:1789115506.237286:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789115506.237289:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c5c00, rc 0) 00000100:00100000:0.0:1789115506.237346:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+61:10751:x1876023288325888:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 345us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115506.237353:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:2.0:1789115506.247922:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115506.248122:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288326016 00000100:00100000:0.0:1789115506.248131:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288326016 00000100:00100000:0.0:1789115506.248205:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:0.0:1789115506.248217:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+9:2352:x1876023288326016:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115506.248237:0:6885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115506.248263:0:6885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3c9f expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789115506.248291:0:6885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3bc71, blocks: 0x1 00010000:00010000:0.0:1789115506.248312:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=323s v=(0 0) 00010000:00010000:0.0:1789115506.248318:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115506.248328:0:6885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c9f expref: 10 pid: 6885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.248348:0:6885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c9f expref: 10 pid: 6885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.248361:0:6885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c4400, rc 0) 00000100:00100000:0.0:1789115506.248451:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+10:2352:x1876023288326016:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 236us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115506.248459:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:0.0:1789115506.251891:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115506.252058:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288326272 00000100:00100000:1.0:1789115506.252093:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288326272 00000100:00100000:1.0:1789115506.252148:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:1.0:1789115506.252159:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4ce52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+61:10751:x1876023288326272:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789115506.252280:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4ce52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+61:10751:x1876023288326272:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 122us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115506.252288:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:2.0:1789115506.256062:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115506.256461:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288326400 00000100:00100000:0.0:1789115506.256470:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288326400 00000100:00100000:0.0:1789115506.256529:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:0.0:1789115506.256539:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+10:10751:x1876023288326400:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115506.256556:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115506.256574:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa8e93cf/0xa47abda6516d39e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3ca6 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.256606:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c9f expref: 11 pid: 6885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.256633:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115506.256638:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115506.256644:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa8e93cf/0xa47abda6516d39e9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ca6 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.256689:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c9f expref: 11 pid: 6885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.256703:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c9f expref: 11 pid: 6885 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115506.256717:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4ce4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1876023308264320:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115506.256813:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a52300 going to sleep for 11 seconds 00000100:00100000:0.0:1789115506.259444:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4ce4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1876023308264320:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115506.259481:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa8e93cf/0xa47abda6516d39e9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ca6 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.259500:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c5400, rc 0) 00000100:00100000:0.0:1789115506.259560:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+11:10751:x1876023288326400:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 3022us (3507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115506.259568:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:1.0:1789115506.262097:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115506.262167:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288326528 00000100:00100000:3.0:1789115506.262178:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288326528 00010000:00010000:3.0:1789115506.262234:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c9f expref: 11 pid: 6885 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115506.262275:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:3.0:1789115506.262284:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+11:2352:x1876023288326528:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115506.262300:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115506.262323:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c9f expref: 11 pid: 6885 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.262356:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c9f expref: 11 pid: 6885 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.262412:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c9f expref: 11 pid: 6885 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.262429:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115506.262434:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115506.262444:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa8e93cf/0xa47abda6516d39e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ca6 expref: 10 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.262455:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa8e93cf/0xa47abda6516d39e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ca6 expref: 10 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.262492:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000aa8e93cf/0xa47abda6516d39e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ca6 expref: 10 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115506.262507:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4c252c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1876023308264448:192.168.203.31@tcp:105: 00000100:00100000:3.0:1789115506.262592:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfc2d2540 going to sleep for 11 seconds 00000100:00100000:3.0:1789115506.276241:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4c252c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1876023308264448:192.168.203.31@tcp:105: 00010000:00010000:3.0:1789115506.276267:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115506.276325:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+10:2352:x1876023288326528:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 14041us (14241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115506.276337:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:2.0:1789115506.277975:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115506.278270:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288326656 00000100:00100000:0.0:1789115506.278279:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288326656 00002000:00100000:0.0:1789115506.278323:0:6703:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8dfcc83ac000 x1876023288326656/t0(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:322/0 lens 504/0 e 0 to 0 dl 1789115517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789115506.278345:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcc83ac000 with x1876023288326656 ext(0->12) 00002000:00010000:0.0:1789115506.278352:0:6703:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfcc83ac000 00000100:00100000:0.0:1789115506.278461:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1789115506.278471:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6dbf7574-92fb-4b89-af78-41319f924699+10:2352:x1876023288326656:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789115506.279166:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6dbf7574-92fb-4b89-af78-41319f924699+12:2352:x1876023288326656:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 695us (1195us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789115506.279176:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00002000:00100000:0.0:1789115506.279199:0:6703:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8dfcc83ac000 x1876023288326656/t4294967308(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:322/0 lens 504/448 e 0 to 0 dl 1789115517 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789115506.279208:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcc83ac000 with x1876023288326656 ext(0->12) 00002000:00010000:0.0:1789115506.279213:0:6703:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfcc83ac000 00000100:00100000:1.0:1789115506.287604:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115506.287694:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288326784 00000100:00100000:0.0:1789115506.287703:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288326784 00000100:00100000:0.0:1789115506.287764:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:0.0:1789115506.287775:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+61:10751:x1876023288326784:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789115506.350525:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1789115506.350538:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:0.0:1789115506.350949:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308264704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789115506.351026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115506.351085:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789115506.351091:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4ce4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308264576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789115506.351125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115506.351155:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308264704 00000100:00100000:0.0:1789115506.351161:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308264704 00000100:00100000:0.0:1789115506.351220:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308264576 00000100:00100000:0.0:1789115506.351235:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308264576 00000100:00100000:0.0:1789115506.351255:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789115506.351261:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1876023308264704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789115506.351423:0:6885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789115506.351426:0:6885:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789115505 00002000:00010000:0.0:1789115506.351429:0:6885:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789115506.351431:0:6885:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789115505 -> 1789115505 00002000:00010000:0.0:1789115506.351433:0:6885:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789115506.351472:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3306:x1876023308264704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (446us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789115506.351480:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789115506.351498:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789115506.351505:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1876023308264576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789115506.351518:0:6885:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789115506.351536:0:6885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.351556:0:6885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bab43620/0xa47abda6516d37b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c05 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.351566:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789115506.351571:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789115506.351575:0:6885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39f0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.351602:0:6885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bab43620/0xa47abda6516d37b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c05 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.351628:0:6885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bab43620/0xa47abda6516d37b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c05 expref: 11 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115506.351653:0:6885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6885:1876023308264832:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115506.351715:0:6885:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a529c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789115506.351727:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789115506.351760:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dfcf4ce4000/2, rc 0, transno 4294967309 00000100:00100000:0.0:1789115506.351766:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308264704:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1789115506.352598:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1789115506.352622:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789115506.352766:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dfcd12419c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789115506.352771:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcffd01b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcd1241e40 00000020:00080000:1.0:1789115506.352774:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcffd01500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcf4b29800 00000004:00080000:1.0:1789115506.352797:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:1.0:1789115506.353011:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308264960:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789115506.353066:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115506.353135:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308264960 00000100:00100000:0.0:1789115506.353142:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308264960 00000100:00100000:0.0:1789115506.353317:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789115506.353326:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876023308264960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789115506.353349:0:6699:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1789115506.353378:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3bc6f, atime: 0x6aa3bc6f, ctime: 0x6aa3bc6f, blocks: 0x1 00010000:00010000:0.0:1789115506.353406:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7013078/0xa47abda6516d39f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.353418:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=323s v=(0 0) 00010000:00010000:0.0:1789115506.353422:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115506.353428:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7013078/0xa47abda6516d39f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.353442:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7013078/0xa47abda6516d39f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.353468:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7013078/0xa47abda6516d39f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.353476:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7013078/0xa47abda6516d39f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.353494:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1789115506.366589:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789115506.366736:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+26:10751:x1876023288326784:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 78957us (79137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115506.366748:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:0.0:1789115506.369791:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1876023308264960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16456us (16714us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789115506.369807:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1789115506.369852:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115506.369861:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7013078/0xa47abda6516d39f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.369873:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c4c00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115506.369878:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7013078/0xa47abda6516d39f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.369888:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7013078/0xa47abda6516d39f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.369910:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7013078/0xa47abda6516d39f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.369917:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7013078/0xa47abda6516d39f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.369959:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115506.369961:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115506.369963:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789115506.369974:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1789115506.370798:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1789115506.370823:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dfcc62d4480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789115506.370828:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcc731e900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcc62d4540 00000020:00080000:0.0:1789115506.370831:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcc731e400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcf4c22c00 00000020:00080000:2.0:1789115506.370927:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789115506.371527:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789115506.371748:0:6885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6885:1876023308264832:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115506.371774:0:6885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115506.371896:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115506.372154:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288326912 00000100:00100000:0.0:1789115506.372161:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288326912 00010000:00010000:0.0:1789115506.372207:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bab43620/0xa47abda6516d37b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c05 expref: 12 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115506.372245:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1789115506.372254:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+12:2353:x1876023288326912:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115506.372267:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115506.372272:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bab43620/0xa47abda6516d37b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c05 expref: 12 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.372284:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bab43620/0xa47abda6516d37b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c05 expref: 12 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.372318:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bab43620/0xa47abda6516d37b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c05 expref: 12 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.372332:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789115506.372336:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789115506.372342:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.372352:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39f0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.372376:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115506.372458:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+11:2353:x1876023288326912:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 204us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115506.372466:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00010000:00010000:0.0:1789115506.372489:0:6885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.372497:0:6885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.372506:0:6885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.372513:0:6885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.372536:0:6885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789115506.373051:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3306:x1876023308264576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21545us (21923us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789115506.373060:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1789115506.373083:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115506.373089:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.373097:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c4400 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115506.373100:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.373109:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.373121:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.373128:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db738a23/0xa47abda6516d39f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.373147:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115506.373148:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115506.373150:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789115506.373194:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dfcf4ce4f00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789115506.373201:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4ce4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308264576:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1789115506.377488:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dfcff9d4b40/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789115506.377504:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308264960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789115506.379859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115506.380358:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288327040 00000100:00100000:3.0:1789115506.380368:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288327040 00000100:00100000:3.0:1789115506.380467:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:3.0:1789115506.380477:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+11:2353:x1876023288327040:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789115506.407598:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789115506.434836:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1789115506.434855:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1789115506.435577:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288327040:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 55094us (55719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115506.435589:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:0.0:1789115506.438937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115506.439358:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288327296 00000100:00100000:1.0:1789115506.439367:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288327296 00000100:00100000:1.0:1789115506.439515:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:1.0:1789115506.439524:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+15:10751:x1876023288327296:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789115506.439573:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115506.439598:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d39db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c98 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.439619:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dfcf2157900) 00010000:00010000:1.0:1789115506.439624:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789115506.439662:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d39fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.439680:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d39fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.439690:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d39fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789115506.439893:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001aedce7e reply state 0000000033d419f4 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d39fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115506.439903:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789115506.439994:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+16:10751:x1876023288327296:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 470us (1066us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789115506.440001:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:3.0:1789115506.454489:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115506.455086:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288327424 00000100:00100000:2.0:1789115506.455097:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288327424 00000100:00100000:2.0:1789115506.455164:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:2.0:1789115506.455176:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c26d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288327424:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789115506.455458:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789115506.455462:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789115505 -> 1789115504 00002000:00010000:2.0:1789115506.455465:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789115503 00002000:00010000:2.0:1789115506.455467:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789115505 -> 1789115504 00002000:00010000:2.0:1789115506.455470:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789115506.455526:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c26d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288327424:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 352us (1046us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789115506.455533:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00010000:00010000:1.0:1789115506.458282:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d39fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.458300:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d39fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.458327:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d39fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.458334:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115506.458340:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d39fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.458349:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d39fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.458366:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dfcf2157900) 00010000:00010000:1.0:1789115506.458369:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115506.458374:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d39fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.458395:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d39fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115506.464075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115506.464304:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288327680 00000100:00100000:3.0:1789115506.464312:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288327680 00000100:00100000:3.0:1789115506.464367:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:3.0:1789115506.464377:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+15:10751:x1876023288327680:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789115506.464667:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.464685:0:8213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d39bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c8a expref: 15 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.464694:0:8213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.464726:0:8213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d39bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c8a expref: 15 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.464741:0:8213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d39bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c8a expref: 15 pid: 8213 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115506.464754:0:8213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4c252c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308265088:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115506.464849:0:8213:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfc2d2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789115506.468443:0:8213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4c252c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308265088:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789115506.468475:0:8213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115506.469776:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115506.469870:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288327808 00000100:00100000:1.0:1789115506.469879:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288327808 00010000:00010000:1.0:1789115506.469921:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d39bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c8a expref: 16 pid: 8213 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115506.469972:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:1.0:1789115506.469982:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+16:2352:x1876023288327808:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115506.469996:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115506.470003:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d39bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c8a expref: 16 pid: 8213 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.470027:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d39bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c8a expref: 16 pid: 8213 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.470049:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d39bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c8a expref: 16 pid: 8213 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.470064:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dfcf2157900) 00010000:00010000:1.0:1789115506.470069:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.470077:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.470086:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.470122:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115506.470176:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+15:2352:x1876023288327808:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 196us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115506.470194:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00010000:00010000:2.0:1789115506.471221:0:8213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115506.471232:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115506.471257:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115506.471264:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115506.471271:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115506.471276:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115506.471280:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115506.471286:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115506.471298:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dfcf2157900) 00010000:00010000:2.0:1789115506.471300:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789115506.471304:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115506.471310:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3a05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115506.471418:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+14:10751:x1876023288327680:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 7004us (7314us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789115506.471427:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:2.0:1789115506.474917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115506.474995:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288327936 00000100:00100000:0.0:1789115506.475004:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288327936 00000100:00100000:0.0:1789115506.475057:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:0.0:1789115506.475068:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288327936:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789115506.475228:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003d17fd54/0xa47abda6516d3a0c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.475250:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa8e93cf/0xa47abda6516d39e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ca6 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.475260:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115506.475264:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789115506.475268:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d17fd54/0xa47abda6516d3a0c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.475304:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa8e93cf/0xa47abda6516d39e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ca6 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.475318:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa8e93cf/0xa47abda6516d39e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ca6 expref: 7 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115506.475329:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1876023308265216:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115506.475590:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a52480 going to sleep for 11 seconds 00000100:00100000:0.0:1789115506.477465:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1876023308265216:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115506.477491:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003d17fd54/0xa47abda6516d3a0c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115506.478516:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115506.478602:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288328064 00000100:00100000:3.0:1789115506.478610:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288328064 00010000:00010000:3.0:1789115506.478646:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa8e93cf/0xa47abda6516d39e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ca6 expref: 8 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115506.478694:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:3.0:1789115506.478704:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288328064:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115506.478719:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115506.478743:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa8e93cf/0xa47abda6516d39e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ca6 expref: 8 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.478757:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa8e93cf/0xa47abda6516d39e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ca6 expref: 8 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.478779:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa8e93cf/0xa47abda6516d39e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ca6 expref: 8 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.478796:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789115506.478800:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789115506.478805:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d17fd54/0xa47abda6516d3a0c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.478814:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d17fd54/0xa47abda6516d3a0c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.478838:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115506.478883:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288328064:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 180us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115506.478899:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00010000:00010000:1.0:1789115506.479079:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003d17fd54/0xa47abda6516d3a0c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.479108:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d17fd54/0xa47abda6516d3a0c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.479136:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003d17fd54/0xa47abda6516d3a0c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.479151:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d17fd54/0xa47abda6516d3a0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.479162:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d17fd54/0xa47abda6516d3a0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.479170:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f600 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115506.479174:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d17fd54/0xa47abda6516d3a0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.479192:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d17fd54/0xa47abda6516d3a0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.479205:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d17fd54/0xa47abda6516d3a0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.479212:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d17fd54/0xa47abda6516d3a0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115506.479259:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288327936:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 4193us (4350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115506.479266:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:0.0:1789115506.484869:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115506.484941:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288328320 00000100:00100000:1.0:1789115506.484951:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288328320 00000100:00100000:1.0:1789115506.485013:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:1.0:1789115506.485037:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+14:10751:x1876023288328320:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789115506.485125:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3a13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.485142:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3a13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.485154:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3a13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.485375:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.485422:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d39cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c91 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.485431:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.485464:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d39cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c91 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.485479:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d39cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c91 expref: 15 pid: 5852 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115506.485492:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc0852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308265344:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115506.485565:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789115506.489506:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc0852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308265344:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115506.489533:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115506.490194:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115506.491063:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288328448 00000100:00100000:1.0:1789115506.491073:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288328448 00010000:00010000:1.0:1789115506.491309:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d39cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c91 expref: 16 pid: 5852 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115506.491352:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:1.0:1789115506.491363:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+16:2352:x1876023288328448:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115506.491379:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115506.491406:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d39cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c91 expref: 16 pid: 5852 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.491420:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d39cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c91 expref: 16 pid: 5852 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.491443:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d39cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c91 expref: 16 pid: 5852 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.491460:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dfcf2157900) 00010000:00010000:1.0:1789115506.491465:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.491474:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.491481:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.491513:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115506.491585:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+15:2352:x1876023288328448:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 224us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115506.491594:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00010000:00010000:0.0:1789115506.491777:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.491785:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789115506.491965:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1789115506.492136:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789115506.492320:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1789115506.492441:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5851:1876023308265472:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789115506.492497:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115506.492530:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a52840 going to sleep for 11 seconds 00000100:00100000:3.0:1789115506.493313:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308265472 00000100:00100000:3.0:1789115506.493322:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308265472 00000100:00100000:3.0:1789115506.493359:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789115506.493367:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1876023308265472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789115506.493477:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1876023308265472:12345-0@lo:1000:mdt00_001.0 Request processed in 110us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115506.493485:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789115506.493633:0:5851:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789115506.493639:0:5851:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1789115506.493659:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dfcf4ce4000, transno 4294967309 00000004:00080000:0.0:1789115506.493683:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dfcf4ce4f00, transno 4294967310 00000100:00100000:0.0:1789115506.493690:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5851:1876023308265472:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789115506.494143:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1789115506.495017:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4c24f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5851:1876023308265600:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789115506.495096:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115506.496472:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfc2d2900 going to sleep for 11 seconds 00000100:00100000:2.0:1789115506.496604:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308265600 00000100:00100000:2.0:1789115506.496613:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308265600 00000100:00100000:2.0:1789115506.496667:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789115506.496677:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1876023308265600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789115506.496908:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5851:x1876023308265600:12345-0@lo:1000:mdt00_001.0 Request processed in 232us (1823us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789115506.496916:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789115506.497034:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4c24f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5851:1876023308265600:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789115506.497072:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497081:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497099:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497173:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115506.497177:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497254:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497284:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dfcf2157900) 00010000:00010000:3.0:1789115506.497287:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789115506.497291:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497297:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a1a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497325:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d395d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497599:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d395d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497609:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d395d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497615:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115506.497618:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d395d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497624:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d395d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497633:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:3.0:1789115506.497636:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789115506.497648:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3964 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c75 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497659:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3964 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c75 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497675:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3964 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c75 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.497707:0:5851:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3964 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c75 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115506.497720:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf4c252c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308265728:192.168.203.31@tcp:105: 00000100:00100000:3.0:1789115506.497783:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfc2d2900 going to sleep for 11 seconds 00000100:00100000:2.0:1789115506.501279:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115506.501505:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288328576 00000100:00100000:1.0:1789115506.501513:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288328576 00000100:00100000:1.0:1789115506.501567:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1789115506.501577:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+19:10750:x1876023288328576:12345-192.168.203.31@tcp:49:lfs.0 00000100:00100000:1.0:1789115506.501834:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+19:10750:x1876023288328576:12345-192.168.203.31@tcp:49:lfs.0 Request processed in 257us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115506.501842:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:3.0:1789115506.503650:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf4c252c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308265728:192.168.203.31@tcp:105: 00010000:00010000:3.0:1789115506.503743:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d395d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503755:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d395d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503792:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3a21 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503806:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3a21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503818:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3a21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503828:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3a21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503834:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3a21 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503855:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3a21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503861:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115506.503864:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3a21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503871:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3a21 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503884:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:3.0:1789115506.503887:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115506.503891:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3a21 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503897:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3a21 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503907:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3a13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503914:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3a13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503920:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3a13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503925:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115506.503928:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3a13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503944:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3a13 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503952:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:3.0:1789115506.503955:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789115506.503958:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3a13 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.503963:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3a13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115506.504492:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+18:10751:x1876023288328320:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 19454us (19629us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1789115506.504504:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 127 00000020:00080000:3.0:1789115506.504510:0:5851:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789115506.504716:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789115506.504721:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789115506.505637:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789115506.505650:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789115506.507813:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115506.510312:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115506.510554:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288328832 00000100:00100000:3.0:1789115506.510564:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288328832 00000100:00100000:3.0:1789115506.510653:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:3.0:1789115506.510673:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+18:10750:x1876023288328832:12345-192.168.203.31@tcp:58:lfs.0 00000040:00080000:3.0:1789115506.511026:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789115506.511325:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+18:10750:x1876023288328832:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 662us (3520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115506.511424:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:1.0:1789115506.511820:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288329088 00000100:00100000:1.0:1789115506.511828:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288329088 00000100:00100000:1.0:1789115506.511866:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:1.0:1789115506.511875:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd8a4c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+18:10751:x1876023288329088:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789115506.512610:0:5853:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789115506.512728:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1789115506.512771:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.512787:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.512798:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.512819:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a28 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.512826:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a28 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.512833:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.512854:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789115506.512889:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115506.512895:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.512902:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6e00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115506.512905:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.512913:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.512925:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dfcd01ae500) 00010000:00010000:1.0:1789115506.512928:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789115506.512931:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a28 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.512937:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3a28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115506.512953:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115506.512955:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115506.512962:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115506.513026:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd8a4c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+20:10751:x1876023288329088:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 1150us (2720us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789115506.513035:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000020:00080000:1.0:1789115506.513040:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789115506.541058:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115506.541278:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288329216 00000100:00100000:0.0:1789115506.541288:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288329216 00000100:00100000:0.0:1789115506.541432:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:0.0:1789115506.541443:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+20:10753:x1876023288329216:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115506.541467:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115506.541489:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3a2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3cad expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.541569:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3a36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.541583:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.541595:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.541609:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3a3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.541617:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.541623:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.541885:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3a44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.541897:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c6e expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.541905:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3a44 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.541937:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c6e expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.541963:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c6e expref: 21 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115506.541977:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308265856:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115506.542042:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115506.544953:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308265856:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115506.544982:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3a44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115506.545054:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115506.545132:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288329472 00000100:00100000:1.0:1789115506.545140:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288329472 00000100:00100000:1.0:1789115506.545204:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:1.0:1789115506.545214:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+22:9234:x1876023288329472:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789115506.545473:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+23:9234:x1876023288329472:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 260us (418us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1789115506.545481:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1789115506.547689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115506.547788:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288329600 00000100:00100000:3.0:1789115506.547797:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288329600 00010000:00010000:3.0:1789115506.547834:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c6e expref: 23 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115506.547967:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:3.0:1789115506.547977:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+23:2352:x1876023288329600:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115506.547993:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115506.548001:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c6e expref: 23 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.548013:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c6e expref: 23 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.548036:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d394f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c6e expref: 23 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.548052:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:3.0:1789115506.548058:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3a44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.548067:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.548075:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3a44 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115506.548112:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115506.548405:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548414:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115506.548456:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789115506.548460:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115506.548480:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548493:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548501:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548508:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3a36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548528:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548533:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115506.548537:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548544:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3a36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548554:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:0.0:1789115506.548557:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115506.548561:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3a36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548567:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3a36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548577:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548584:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3a3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548589:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548594:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ea00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115506.548597:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548612:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3a3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548620:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dfcd044f200) 00010000:00010000:0.0:1789115506.548622:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115506.548625:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3a3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548631:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3a3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548664:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3a2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cad expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548676:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3a44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cad expref: 22 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115506.548683:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:0.0:1789115506.548685:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115506.548687:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f600, rc 0) 00000100:00100000:1.0:1789115506.549095:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+22:2352:x1876023288329600:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1117us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115506.549116:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:1.0:1789115506.549165:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+21:10753:x1876023288329216:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 7725us (8117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115506.549172:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 129 00000040:00080000:2.0:1789115507.429200:0:12493:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789115507.429210:0:12493:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789115507.429253:0:12493:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789115507.429260:0:12493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789115507.430969:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789115507.555612:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789115507.555622:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789115507.555742:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789115507.555749:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789115507.555869:0:12072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc0852c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876023308265984:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789115507.556338:0:12072:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789115507.562632:0:12072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc0852c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876023308265984:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789115507.571642:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115507.571729:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288329728 00000100:00100000:2.0:1789115507.571740:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288329728 00000100:00100000:2.0:1789115507.571816:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:2.0:1789115507.571827:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc0852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+21:10765:x1876023288329728:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789115507.571868:0:8213:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789115507.571976:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc0852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+21:10765:x1876023288329728:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 150us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115507.571984:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00080000:1.0:1789115507.572209:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115507.579721:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115507.579764:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288329984 00000100:00100000:3.0:1789115507.579774:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288329984 00000100:00100000:3.0:1789115507.579849:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:3.0:1789115507.579859:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+21:10765:x1876023288329984:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789115507.579890:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115507.579912:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d3a4b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3cb4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115507.580015:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3a52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115507.580030:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115507.580041:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115507.580053:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789115507.580215:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d3a4b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cb4 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115507.580231:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cb4 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115507.580239:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:3.0:1789115507.580242:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789115507.580246:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ebe00, rc 0) 00000100:00100000:3.0:1789115507.580310:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+23:10765:x1876023288329984:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 452us (597us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789115507.580318:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:3.0:1789115507.598644:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115507.598692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115507.598766:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288330368 00000100:00100000:0.0:1789115507.598777:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288330368 00000100:00100000:0.0:1789115507.598885:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:0.0:1789115507.598896:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+23:2350:x1876023288330368:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115507.598913:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115507.598938:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3a52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cb4 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115507.598987:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:0.0:1789115507.598992:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115507.599043:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+22:2350:x1876023288330368:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 149us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115507.599051:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1789115507.599267:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288330240 00000100:00100000:2.0:1789115507.599272:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288330240 00000100:00100000:2.0:1789115507.599303:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:2.0:1789115507.599311:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+22:10765:x1876023288330240:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789115507.599410:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3a60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115507.599424:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3a60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115507.599436:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3a60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115507.599631:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3a60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115507.599638:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3a60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115507.599644:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3a60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115507.599650:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115507.599655:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3a60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115507.599675:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3a60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115507.599687:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:2.0:1789115507.599690:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789115507.599694:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3a60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115507.599700:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3a60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115507.599835:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+23:10765:x1876023288330240:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 524us (1200us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789115507.599843:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 132 00000040:00080000:2.0:1789115507.600020:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789115507.600024:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789115507.600576:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789115507.600587:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789115507.605718:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115507.606522:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288330624 00000100:00100000:2.0:1789115507.606533:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288330624 00000100:00100000:2.0:1789115507.606590:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1789115507.606600:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff912580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+23:10765:x1876023288330624:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789115507.609129:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff912580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+24:10765:x1876023288330624:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 2518us (3409us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789115507.609144:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:0.0:1789115508.197550:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115508.197613:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115508.197621:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288330880 00000100:00100000:3.0:1789115508.197641:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288330880 00000100:00100000:0.0:1789115508.197661:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115508.197683:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115508.197709:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:0.0:1789115508.197725:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115508.197726:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+24:2351:x1876023288330880:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115508.197760:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288331264 00000100:00100000:0.0:1789115508.197765:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288331264 00000100:00100000:0.0:1789115508.197801:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:3.0:1789115508.197811:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+24:2351:x1876023288330880:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115508.197812:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288331264:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115508.197826:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:0.0:1789115508.197848:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2351:x1876023288331264:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 39us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115508.197856:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:0.0:1789115508.197880:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288331136 00000100:00100000:0.0:1789115508.197884:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288331136 00000100:00100000:0.0:1789115508.197906:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288331008 00000100:00100000:0.0:1789115508.197908:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288331008 00000100:00100000:0.0:1789115508.197927:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:0.0:1789115508.197934:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2351:x1876023288331136:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115508.197972:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2351:x1876023288331136:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 38us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115508.197990:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:0.0:1789115508.198008:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:0.0:1789115508.198017:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2351:x1876023288331008:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115508.198059:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2351:x1876023288331008:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115508.198065:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:1.0:1789115508.198345:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288330752 00000100:00100000:1.0:1789115508.198350:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288330752 00000100:00100000:1.0:1789115508.198416:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 318 00000100:00100000:1.0:1789115508.198423:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd0759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2351:x1876023288330752:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115508.198452:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd0759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2351:x1876023288330752:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 30us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115508.198457:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 318 00000100:00080000:1.0:1789115508.198482:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789115508.198486:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789115508.198489:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115508.389760:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115508.389787:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc085680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308266112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789115508.389861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115508.390047:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308266112 00000100:00100000:0.0:1789115508.390054:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308266112 00000100:00100000:0.0:1789115508.390124:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789115508.390133:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876023308266112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789115508.390176:0:12414:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115508.390225:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876023308266112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115508.390233:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789115508.390325:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc085680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308266112:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789115508.390404:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789115508.451636:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789115508.936533:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1789115508.936560:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:1.0:1789115509.341650:0:12546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789115509.341659:0:12546:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789115509.341703:0:12546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789115509.341708:0:12546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789115509.413014:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8852940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308266240:0@lo:400:kworker.0 00000100:00100000:3.0:1789115509.413081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115509.413122:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc2d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308266752:0@lo:400:kworker.0 00000100:00100000:3.0:1789115509.413148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115509.413183:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789115509.413189:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308266368:0@lo:400:kworker.0 00000100:00100000:3.0:1789115509.413210:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115509.413234:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc2d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308266880:0@lo:400:kworker.0 00000100:00100000:3.0:1789115509.413257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115509.413285:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308266496:0@lo:400:kworker.0 00000100:00100000:3.0:1789115509.413322:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115509.413343:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115509.413349:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308266624:0@lo:400:kworker.0 00000100:00100000:3.0:1789115509.413372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115509.413434:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308266752 00000100:00100000:3.0:1789115509.413441:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308266752 00000100:00100000:3.0:1789115509.413485:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308266368 00000100:00100000:3.0:1789115509.413488:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308266368 00000100:00100000:3.0:1789115509.413502:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308266496 00000100:00100000:3.0:1789115509.413505:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308266496 00000100:00100000:3.0:1789115509.413523:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789115509.413530:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308266752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115509.413579:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308266752:12345-0@lo:400:kworker.0 Request processed in 49us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115509.413585:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789115509.413601:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789115509.413607:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308266368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115509.413630:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308266368:12345-0@lo:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115509.413635:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789115509.413644:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789115509.413649:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308266496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115509.413674:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308266496:12345-0@lo:400:kworker.0 Request processed in 25us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115509.413679:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789115509.413712:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308266496:0@lo:400:kworker.0 00000100:00100000:3.0:1789115509.413736:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308266368:0@lo:400:kworker.0 00000100:00100000:3.0:1789115509.413744:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc2d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308266752:0@lo:400:kworker.0 00000100:00100000:1.0:1789115509.416419:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308266240 00000100:00100000:1.0:1789115509.416433:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308266240 00000100:00100000:1.0:1789115509.416492:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789115509.416502:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd075bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308266240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115509.416597:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd075bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308266240:12345-0@lo:400:kworker.0 Request processed in 97us (3516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115509.416605:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789115509.416641:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308266880 00000100:00100000:1.0:1789115509.416645:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308266880 00000100:00100000:1.0:1789115509.416677:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308266624 00000100:00100000:1.0:1789115509.416689:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308266624 00000100:00100000:1.0:1789115509.416712:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789115509.416717:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876023308266880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115509.416752:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876023308266880:12345-0@lo:400:kworker.0 Request processed in 35us (3495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115509.416758:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789115509.416769:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789115509.416775:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308266624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115509.416810:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308266624:12345-0@lo:400:kworker.0 Request processed in 35us (3437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115509.416816:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1789115509.416832:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789115509.416836:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115509.416880:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc2d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308266880:0@lo:400:kworker.0 00000100:00100000:1.0:1789115509.416891:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8852940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308266240:0@lo:400:kworker.0 00000100:00100000:1.0:1789115509.416930:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789115509.416935:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1789115509.416951:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dfcff9d4b40, transno 4294967304 00000100:00100000:1.0:1789115509.416963:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308266624:0@lo:400:kworker.0 00010000:00010000:3.0:1789115509.479017:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115509.524213:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115509.524319:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288331520 00000100:00100000:0.0:1789115509.524328:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288331520 00000100:00100000:0.0:1789115509.524724:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:0.0:1789115509.524734:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+24:10786:x1876023288331520:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115509.524758:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115509.524780:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3a67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3cbb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115509.524881:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d3a6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115509.524903:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d3a6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115509.524915:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d3a6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115509.524928:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789115509.525053:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3a67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cbb expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115509.525069:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d3a6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cbb expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115509.525077:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:0.0:1789115509.525080:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789115509.525084:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c5400, rc 0) 00000100:00100000:0.0:1789115509.525134:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+26:10786:x1876023288331520:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 402us (930us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789115509.525141:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:3.0:1789115509.531572:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115509.531654:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288331648 00000100:00100000:0.0:1789115509.531662:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288331648 00000100:00100000:0.0:1789115509.531720:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:0.0:1789115509.531730:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+26:10786:x1876023288331648:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:0.0:1789115509.531797:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3a7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115509.531814:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115509.531842:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115509.531869:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115509.531876:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3a7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115509.531882:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115509.531888:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c5c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115509.531893:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115509.531900:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3a7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115509.531912:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:0.0:1789115509.531915:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789115509.531919:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3a7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115509.531925:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3a7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115509.531991:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+26:10786:x1876023288331648:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 261us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115509.531998:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00080000:1.0:1789115509.533994:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115509.639298:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115509.639507:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288331776 00000100:00100000:1.0:1789115509.639518:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288331776 00000100:00100000:1.0:1789115509.639637:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1789115509.639658:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288331776:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:1.0:1789115509.639677:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115509.639697:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003c056a0/0xa47abda6516d3a83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3cc2 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789115509.639745:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3bc70, atime: 0x6aa3bc6f, ctime: 0x6aa3bc70, blocks: 0xb 00010000:00010000:1.0:1789115509.639766:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1789115509.639770:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115509.639780:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003c056a0/0xa47abda6516d3a83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cc2 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115509.639799:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000003c056a0/0xa47abda6516d3a83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cc2 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115509.639812:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6400, rc 0) 00000100:00100000:1.0:1789115509.639873:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288331776:12345-192.168.203.31@tcp:101:cat.0 Request processed in 227us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115509.639881:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:3.0:1789115509.646730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115509.646826:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288331904 00000100:00100000:2.0:1789115509.646837:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288331904 00002000:00100000:2.0:1789115509.646896:0:6704:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8dfcfc3c1a40 x1876023288331904/t0(0) o3->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:325/0 lens 488/0 e 0 to 0 dl 1789115520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789115509.646908:0:6704:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcfc3c1a40 with x1876023288331904 ext(0->4095) 00002000:00010000:2.0:1789115509.646914:0:6704:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfcfc3c1a40 00000100:00100000:2.0:1789115509.646947:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:2.0:1789115509.646956:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288331904:12345-192.168.203.31@tcp:3:cat.0 00000100:00100000:2.0:1789115509.647181:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288331904:12345-192.168.203.31@tcp:3:cat.0 Request processed in 225us (459us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789115509.648210:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00002000:00100000:2.0:1789115509.648224:0:6704:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8dfcfc3c1a40 x1876023288331904/t0(0) o3->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:325/0 lens 488/4536 e 0 to 0 dl 1789115520 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789115509.648235:0:6704:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcfc3c1a40 with x1876023288331904 ext(0->4095) 00002000:00010000:2.0:1789115509.648240:0:6704:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfcfc3c1a40 00000100:00100000:3.0:1789115509.923901:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789115509.923921:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308267008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115509.924052:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115509.924325:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308267008 00000100:00100000:2.0:1789115509.924333:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308267008 00000100:00100000:2.0:1789115509.924477:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789115509.924488:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308267008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789115509.924518:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115509.924566:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308267008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115509.924573:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789115509.924651:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308267008:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789115510.499799:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789115511.510317:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1789115511.510360:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1789115511.522328:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1789115511.522349:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dfcd8a52840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789115511.522354:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcfcfde700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcd8a52b40 00000020:00080000:1.0:1789115511.522357:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcfcfde300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcedbc5800 00000020:00080000:3.0:1789115511.522729:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:1.0:1789115511.522789:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1789115511.522940:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1789115511.524607:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115512.548229:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115513.321826:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115513.321933:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115513.321967:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115513.322001:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115513.322025:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115513.322056:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288332544 00000100:00100000:2.0:1789115513.322065:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288332544 00000100:00100000:2.0:1789115513.322123:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288332160 00000100:00100000:2.0:1789115513.322126:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288332160 00000100:00100000:1.0:1789115513.322256:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288332288 00000100:00100000:1.0:1789115513.322261:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288332288 00000100:00100000:1.0:1789115513.322289:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288332416 00000100:00100000:1.0:1789115513.322293:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288332416 00000100:00100000:1.0:1789115513.322327:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:1.0:1789115513.322337:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288332288:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115513.322435:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2353:x1876023288332288:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 98us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115513.322443:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:1.0:1789115513.322460:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:1.0:1789115513.322467:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288332416:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115513.322493:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288332416:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115513.322500:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:1.0:1789115513.322553:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:1.0:1789115513.322560:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288332544:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115513.322590:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288332544:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 30us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115513.322597:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00080000:1.0:1789115513.322750:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789115513.322755:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789115513.322757:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115513.324362:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:2.0:1789115513.324375:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+13:2353:x1876023288332160:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115513.324458:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+13:2353:x1876023288332160:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 85us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115513.324465:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:3.0:1789115513.329555:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288332032 00000100:00100000:3.0:1789115513.329571:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288332032 00000100:00100000:3.0:1789115513.329667:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 320 00000100:00100000:3.0:1789115513.329677:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2353:x1876023288332032:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115513.329758:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2353:x1876023288332032:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 82us (7940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115513.329766:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 320 00000100:00100000:2.0:1789115513.508492:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789115513.508516:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308267136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789115513.508593:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115513.509310:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308267136 00000100:00100000:3.0:1789115513.509321:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308267136 00000100:00100000:3.0:1789115513.509421:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789115513.509433:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308267136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789115513.509468:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115513.509529:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308267136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115513.509536:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1789115513.511410:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789115513.512287:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308267136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789115513.573211:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789115513.764163:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789115513.764172:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789115513.764471:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1789115513.764485:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789115514.240703:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115514.240836:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288332672 00000100:00100000:0.0:1789115514.240846:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288332672 00000100:00100000:0.0:1789115514.240902:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:0.0:1789115514.240912:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc0843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+13:10430:x1876023288332672:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789115514.241013:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc0843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+13:10430:x1876023288332672:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 Request processed in 102us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115514.241021:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:3.0:1789115514.243355:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115514.243505:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288332928 00000100:00100000:2.0:1789115514.243515:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288332928 00000100:00100000:2.0:1789115514.243571:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:2.0:1789115514.243580:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+13:10430:x1876023288332928:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789115514.244120:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+14:10430:x1876023288332928:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 539us (771us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789115514.244140:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:2.0:1789115514.522265:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115514.522415:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288333056 00000100:00100000:0.0:1789115514.522424:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288333056 00000100:00100000:0.0:1789115514.522489:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:0.0:1789115514.522499:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:11240:x1876023288333056:12345-192.168.203.31@tcp:101:lsof.0 00010000:00010000:0.0:1789115514.522518:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115514.522541:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3a8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3cc9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115514.522600:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3a91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115514.522614:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115514.522626:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115514.522812:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789115514.522817:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115514.522916:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115514.522942:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3a8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cc9 expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115514.522967:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3a91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cc9 expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115514.522976:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcf2157400) 00010000:00010000:0.0:1789115514.522979:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789115514.522983:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c5e00, rc 0) 00000100:00100000:0.0:1789115514.523049:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:11240:x1876023288333056:12345-192.168.203.31@tcp:101:lsof.0 Request processed in 552us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115514.523057:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:2.0:1789115514.534836:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc085e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308267264:0@lo:400:kworker.0 00000100:00100000:2.0:1789115514.534912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115514.534964:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308267776:0@lo:400:kworker.0 00000100:00100000:2.0:1789115514.534992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115514.535033:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789115514.535039:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc084f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308267392:0@lo:400:kworker.0 00000100:00100000:2.0:1789115514.535061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115514.535080:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308267904:0@lo:400:kworker.0 00000100:00100000:2.0:1789115514.535105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115514.535150:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308267904 00000100:00100000:2.0:1789115514.535157:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308267904 00000100:00100000:2.0:1789115514.535208:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789115514.535216:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308267904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115514.535263:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308267904:12345-0@lo:400:kworker.0 Request processed in 48us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115514.535271:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789115514.535294:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308267776 00000100:00100000:2.0:1789115514.535297:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308267776 00000100:00100000:2.0:1789115514.535319:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308267392 00000100:00100000:2.0:1789115514.535322:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308267392 00000100:00100000:2.0:1789115514.535338:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789115514.535344:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308267776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115514.535374:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308267776:12345-0@lo:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115514.535401:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789115514.535413:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789115514.535419:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308267392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115514.535446:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308267392:12345-0@lo:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115514.535452:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789115514.535487:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc084f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308267392:0@lo:400:kworker.0 00000100:00100000:2.0:1789115514.535506:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1789115514.535511:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1789115514.535535:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308267904:0@lo:400:kworker.0 00000100:00100000:2.0:1789115514.535545:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308267776:0@lo:400:kworker.0 00000100:00100000:1.0:1789115514.536368:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308267264 00000100:00100000:1.0:1789115514.536415:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308267264 00000100:00100000:1.0:1789115514.536470:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789115514.536478:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308267264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115514.536538:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308267264:12345-0@lo:400:kworker.0 Request processed in 62us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115514.536553:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789115514.536779:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc086940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308267520:0@lo:400:kworker.0 00000100:00100000:3.0:1789115514.536814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115514.536847:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115514.536853:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc085680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308267648:0@lo:400:kworker.0 00000100:00100000:3.0:1789115514.536876:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115514.536910:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308267648 00000100:00100000:3.0:1789115514.536914:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308267648 00000100:00100000:3.0:1789115514.536944:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789115514.536950:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308267648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115514.536986:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308267648:12345-0@lo:400:kworker.0 Request processed in 36us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115514.536991:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789115514.537036:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc085680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308267648:0@lo:400:kworker.0 00000100:00080000:0.0:1789115514.537158:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789115514.537165:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789115514.537175:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308267520 00000100:00100000:0.0:1789115514.537178:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308267520 00000100:00100000:0.0:1789115514.537213:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789115514.537219:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308267520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115514.537256:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308267520:12345-0@lo:400:kworker.0 Request processed in 37us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115514.537261:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1789115514.537838:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115514.537862:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc086940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308267520:0@lo:400:kworker.0 00000100:00100000:2.0:1789115514.538740:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc085e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308267264:0@lo:400:kworker.0 00010000:00010000:1.0:1789115514.596355:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115515.046957:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789115515.046982:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308268032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789115515.047063:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115515.047581:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308268032 00000100:00100000:0.0:1789115515.047590:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308268032 00000100:00100000:0.0:1789115515.047655:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789115515.047665:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308268032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115515.047698:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115515.047753:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308268032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115515.047760:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789115515.047928:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308268032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789115515.619799:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115516.644324:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789115516.654945:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1789115516.654976:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789115516.655256:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789115516.655267:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1789115517.667662:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789115518.238136:0:12750:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:31:56 (1789115516) 00000100:00100000:3.0:1789115518.438234:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115518.438297:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115518.438326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115518.438347:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115518.438370:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115518.438478:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288333440 00000100:00100000:2.0:1789115518.438487:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288333440 00000100:00100000:2.0:1789115518.438547:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288333568 00000100:00100000:2.0:1789115518.438551:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288333568 00000100:00100000:2.0:1789115518.438576:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00080000:3.0:1789115518.438666:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789115518.438671:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789115518.438734:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288333696 00000100:00100000:0.0:1789115518.438739:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288333696 00000100:00100000:0.0:1789115518.438772:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288333312 00000100:00100000:0.0:1789115518.438775:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288333312 00000100:00100000:0.0:1789115518.438795:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:0.0:1789115518.438804:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:2351:x1876023288333696:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115518.438872:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:2351:x1876023288333696:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 69us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115518.438880:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:0.0:1789115518.438897:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:0.0:1789115518.438903:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+13:2351:x1876023288333312:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115518.438931:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+13:2351:x1876023288333312:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115518.438937:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00080000:0.0:1789115518.439068:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115518.439969:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2351:x1876023288333440:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115518.440028:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2351:x1876023288333440:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 73us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115518.441175:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288333184 00000100:00100000:1.0:1789115518.441187:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288333184 00000100:00100000:1.0:1789115518.441241:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 322 00000100:00100000:1.0:1789115518.441250:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2351:x1876023288333184:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115518.441308:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2351:x1876023288333184:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 58us (3084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115518.441315:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 322 00000100:00100000:3.0:1789115518.445223:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:3.0:1789115518.445253:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2351:x1876023288333568:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115518.445344:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2351:x1876023288333568:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 110us (6974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115518.445353:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:2.0:1789115518.445703:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:1.0:1789115518.627958:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc085e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308268160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789115518.628033:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115518.629605:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308268160 00000100:00100000:0.0:1789115518.629617:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308268160 00000100:00100000:0.0:1789115518.629702:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789115518.629713:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308268160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789115518.629750:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115518.629824:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308268160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115518.629832:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789115518.629886:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc085e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308268160:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789115518.630095:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789115518.694010:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115519.628718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115519.629031:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288333952 00000100:00100000:2.0:1789115519.629049:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288333952 00000100:00100000:2.0:1789115519.629198:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:2.0:1789115519.629222:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+13:11506:x1876023288333952:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789115519.629254:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115519.629287:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d3a98 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3cd0 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.629452:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3a9f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.629474:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3a9f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.629493:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3a9f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.629512:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3aa6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.629520:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.629527:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630034:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3aad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630047:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3aad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630055:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3aad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115519.630067:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1789115519.630307:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3a9f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630316:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3a9f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630329:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3a9f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630336:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115519.630341:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3a9f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630350:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3a9f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630363:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dfcf2157f00) 00010000:00010000:2.0:1789115519.630367:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115519.630373:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3a9f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630412:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3a9f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630429:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630435:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3aa6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630441:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630447:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115519.630450:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630467:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630477:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8dfcc5118d00) 00010000:00010000:2.0:1789115519.630479:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115519.630482:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3aa6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630488:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3aa6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630912:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d3a98 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cd0 expref: 16 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630930:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3aad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cd0 expref: 15 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115519.630939:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:2.0:1789115519.630942:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115519.630944:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacdc00, rc 0) 00000100:00100000:2.0:1789115519.631046:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+15:11506:x1876023288333952:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1826us (2891us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789115519.631057:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:3.0:1789115519.636897:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115519.636999:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288334080 00000100:00100000:1.0:1789115519.637013:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288334080 00000100:00100000:1.0:1789115519.637100:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1789115519.637112:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+15:2350:x1876023288334080:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115519.637134:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115519.637175:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3aad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cd0 expref: 15 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115519.637199:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:1.0:1789115519.637222:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115519.637300:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+14:2350:x1876023288334080:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 190us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115519.637309:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1789115519.651727:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308268544:0@lo:400:kworker.0 00000100:00100000:0.0:1789115519.651771:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308268416:0@lo:400:kworker.0 00000100:00100000:1.0:1789115519.651852:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115519.651876:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308268672:0@lo:400:kworker.0 00000100:00100000:0.0:1789115519.651924:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115519.652012:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308268544 00000100:00100000:0.0:1789115519.652022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115519.652027:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308268544 00000100:00100000:0.0:1789115519.652049:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308268928:0@lo:400:kworker.0 00000100:00100000:0.0:1789115519.652109:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115519.652121:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308268416 00000100:00100000:1.0:1789115519.652127:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308268416 00000100:00100000:0.0:1789115519.652162:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789115519.652169:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789115519.652178:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308268288:0@lo:400:kworker.0 00000100:00100000:1.0:1789115519.652186:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308268544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115519.652223:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115519.652266:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308268800:0@lo:400:kworker.0 00000100:00100000:1.0:1789115519.652277:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308268544:12345-0@lo:400:kworker.0 Request processed in 94us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115519.652288:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789115519.652307:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115519.652314:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308268800 00000100:00100000:1.0:1789115519.652320:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308268800 00000100:00100000:1.0:1789115519.652354:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789115519.652358:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308268288 00000100:00100000:1.0:1789115519.652365:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308268416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115519.652369:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308268288 00000100:00100000:1.0:1789115519.652457:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308268416:12345-0@lo:400:kworker.0 Request processed in 94us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115519.652467:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789115519.652489:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789115519.652499:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308268800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115519.652512:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789115519.652527:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308268288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115519.652545:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308268800:12345-0@lo:400:kworker.0 Request processed in 47us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115519.652554:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1789115519.652594:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115519.652614:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308268288:12345-0@lo:400:kworker.0 Request processed in 89us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115519.652641:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308268544:0@lo:400:kworker.0 00000100:00100000:1.0:1789115519.652704:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308268288:0@lo:400:kworker.0 00000100:00100000:1.0:1789115519.652716:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308268800:0@lo:400:kworker.0 00000100:00100000:1.0:1789115519.652727:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308268416:0@lo:400:kworker.0 00000100:00100000:0.0:1789115519.653036:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789115519.653312:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308268672 00000100:00100000:3.0:1789115519.653319:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308268672 00000100:00100000:3.0:1789115519.653359:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308268928 00000100:00100000:3.0:1789115519.653361:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308268928 00000100:00100000:3.0:1789115519.653441:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789115519.653449:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308268672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115519.653511:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308268672:12345-0@lo:400:kworker.0 Request processed in 63us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115519.653517:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789115519.653531:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789115519.653537:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308268928:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789115519.653804:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789115519.653867:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308268672:0@lo:400:kworker.0 00000100:00100000:2.0:1789115519.653894:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115519.653912:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308268928:0@lo:400:kworker.0 00000100:00100000:3.0:1789115519.654264:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308268928:12345-0@lo:400:kworker.0 Request processed in 35us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115519.654290:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789115519.654765:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288334208 00000100:00100000:1.0:1789115519.654777:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288334208 00000100:00100000:1.0:1789115519.655060:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:1.0:1789115519.655072:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc086940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+14:11506:x1876023288334208:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789115519.655918:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc086940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+14:11506:x1876023288334208:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 841us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115519.655928:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 138 00010000:00010000:1.0:1789115519.716515:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789115519.908038:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789115519.908048:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789115519.915125:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789115519.915147:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789115520.165589:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308269056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789115520.165735:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115520.165806:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308269056 00000100:00100000:0.0:1789115520.165814:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308269056 00000100:00100000:0.0:1789115520.166079:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789115520.166097:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308269056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115520.166129:0:12414:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115520.166183:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308269056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115520.166191:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789115520.166267:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308269056:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789115520.741147:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115521.183485:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115521.183571:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288334336 00000100:00100000:1.0:1789115521.183579:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288334336 00000100:00100000:1.0:1789115521.183798:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:1.0:1789115521.183809:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+14:11548:x1876023288334336:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115521.183830:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115521.183850:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3abb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3cd7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.183929:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3ac2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.183943:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3ac2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.183957:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3ac2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.183972:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ac9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.183979:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.183986:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184257:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3ac2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184265:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3ac2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184271:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3ac2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184278:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115521.184282:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3ac2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184300:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3ac2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184312:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcf2157400) 00010000:00010000:1.0:1789115521.184315:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115521.184320:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3ac2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184326:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3ac2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184337:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184342:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ac9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184348:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184354:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115521.184357:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184363:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184370:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115521.184373:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115521.184376:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ac9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184419:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ac9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184451:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3abb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cd7 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184463:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcf2157400) 00010000:00010000:1.0:1789115521.184465:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115521.184469:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3abb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cd7 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.184478:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7a00, rc 0) 00000100:00100000:1.0:1789115521.184538:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+14:11548:x1876023288334336:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 730us (1061us total) trans 0 rc 301/301 00000100:00100000:1.0:1789115521.184547:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00080000:0.0:1789115521.192147:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115521.192399:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115521.192430:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288334592 00000100:00100000:1.0:1789115521.192440:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288334592 00000100:00100000:1.0:1789115521.192497:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:1.0:1789115521.192507:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+14:11548:x1876023288334592:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:1.0:1789115521.192561:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115521.192598:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d3439 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b10 expref: 14 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.192616:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcf2157400) 00010000:00010000:1.0:1789115521.192622:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789115521.192873:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.192894:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3a91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cc9 expref: 5 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.192902:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.192932:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3a91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cc9 expref: 5 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.192946:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3a91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cc9 expref: 5 pid: 5851 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115521.192959:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3be1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308269184:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115521.193045:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd04b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115521.197830:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3be1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308269184:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115521.197865:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115521.208057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115521.208111:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288334720 00000100:00100000:3.0:1789115521.208121:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288334720 00010000:00010000:3.0:1789115521.208177:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3a91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cc9 expref: 6 pid: 5851 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789115521.208183:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115521.208211:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:3.0:1789115521.208221:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:2353:x1876023288334720:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115521.208236:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115521.208243:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3a91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cc9 expref: 6 pid: 5851 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.208259:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3a91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cc9 expref: 6 pid: 5851 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.208281:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3a91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cc9 expref: 6 pid: 5851 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.208294:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcf2157400) 00010000:00010000:3.0:1789115521.208300:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.208309:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.208317:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.208359:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115521.208371:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.208409:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.208431:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3ad7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.208441:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115521.208447:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2353:x1876023288334720:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 227us (397us total) trans 0 rc 0/0 00010000:00010000:0.0:1789115521.208449:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115521.208456:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000004:00200000:0.0:1789115521.209542:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1789115521.209554:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.209568:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.209574:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.209580:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115521.209584:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.209592:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.209602:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcf2157400) 00010000:00010000:0.0:1789115521.209605:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115521.209609:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.209615:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ad0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789115521.209633:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000028ff9ad4 reply state 0000000016801c67 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115521.209642:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789115521.209707:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+15:11548:x1876023288334592:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 17200us (17327us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789115521.209715:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 140 00010000:00010000:2.0:1789115521.213216:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.213249:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3ad7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.213257:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.213263:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c4400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115521.213268:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.213281:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3ad7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.213299:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8dfcd044fe00) 00010000:00010000:2.0:1789115521.213303:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115521.213307:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3ad7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.213314:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3ad7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115521.304060:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115521.304160:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288334848 00000100:00100000:0.0:1789115521.304169:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288334848 00000100:00100000:0.0:1789115521.304241:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:0.0:1789115521.304250:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+14:11556:x1876023288334848:12345-192.168.203.31@tcp:101:lctl.0 00010000:00010000:0.0:1789115521.304285:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115521.304307:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3ade lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3cde expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.304371:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3ae5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.304421:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.304432:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115521.304497:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789115521.304501:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115521.304528:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.304554:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3ade lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cde expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.304583:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cde expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.304591:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:0.0:1789115521.304594:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789115521.304598:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c4c00, rc 0) 00000100:00100000:0.0:1789115521.304651:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+15:11556:x1876023288334848:12345-192.168.203.31@tcp:101:lctl.0 Request processed in 402us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115521.304667:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:0.0:1789115521.362480:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115521.362575:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288334976 00000100:00100000:1.0:1789115521.362585:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288334976 00000100:00100000:1.0:1789115521.362648:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:1.0:1789115521.362658:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+15:11562:x1876023288334976:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1789115521.362677:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115521.362698:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3aec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3ce5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.362774:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3af3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.362804:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3af3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.362816:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3af3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.362834:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3afa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.362841:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3afa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.362847:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3afa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.362951:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.362959:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.362966:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115521.362997:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1789115521.363000:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115521.363028:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363038:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3af3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363054:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3af3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363061:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3af3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363067:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115521.363071:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3af3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363091:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3af3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363104:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:1.0:1789115521.363107:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115521.363112:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3af3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363118:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3af3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363131:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3afa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363137:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3afa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363143:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3afa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363148:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115521.363156:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3afa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363163:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3afa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363170:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115521.363172:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115521.363175:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3afa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363181:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3afa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363215:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3aec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ce5 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363228:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ce5 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.363236:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115521.363239:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789115521.363246:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7a00, rc 0) 00000100:00100000:1.0:1789115521.363313:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+16:11562:x1876023288334976:12345-192.168.203.31@tcp:101:bash.0 Request processed in 657us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115521.363320:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:2.0:1789115521.369467:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115521.369506:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288335232 00000100:00100000:0.0:1789115521.369516:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288335232 00000100:00100000:0.0:1789115521.369614:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:0.0:1789115521.369626:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc084f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+16:11562:x1876023288335232:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1789115521.369646:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115521.369665:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3b08 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3cec expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.369789:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3b0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.369804:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3b0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.369815:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3b0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.369869:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3b16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.369878:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.369885:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789115521.370548:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789115521.370711:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3b1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.370729:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.370739:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.370773:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3b0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.370780:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3b0f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.370787:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3b0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.370793:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c4400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115521.370797:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3b0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.370804:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3b0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.370815:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115521.370819:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115521.370823:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3b0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.370829:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3b0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789115521.370843:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002ce80422 reply state 0000000059e9f1bd transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115521.370857:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789115521.370888:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3b08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cec expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.370902:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cec expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.370909:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:0.0:1789115521.370911:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115521.370913:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e400, rc 0) 00000100:00100000:0.0:1789115521.370990:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc084f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+19:11562:x1876023288335232:12345-192.168.203.31@tcp:101:bash.0 Request processed in 1367us (1536us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789115521.370998:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 143 00010000:00010000:1.0:1789115521.372816:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.372833:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3b16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.372853:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3b16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.372863:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c5e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115521.372868:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3b16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.372876:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3b16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.372891:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcd044f900) 00010000:00010000:1.0:1789115521.372894:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115521.372898:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3b16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.372903:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3b16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115521.380821:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115521.380996:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288335360 00000100:00100000:3.0:1789115521.381126:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288335360 00000100:00100000:3.0:1789115521.381196:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:3.0:1789115521.381208:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc085680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+5:2352:x1876023288335360:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1789115521.381226:0:6885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1789115521.381235:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789115521.381452:0:6885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000597d4772/0xa47abda6516d3b2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3cf3 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789115521.381480:0:6885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789115521.381499:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=338s v=(0 0) 00010000:00010000:3.0:1789115521.381505:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115521.381515:0:6885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000597d4772/0xa47abda6516d3b2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cf3 expref: 6 pid: 6885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.381534:0:6885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000597d4772/0xa47abda6516d3b2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cf3 expref: 6 pid: 6885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.381547:0:6885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ea400, rc 0) 00000100:00100000:3.0:1789115521.381611:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc085680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288335360:12345-192.168.203.31@tcp:101:bash.0 Request processed in 405us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115521.381619:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1789115521.398493:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115521.400127:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288335488 00000100:00100000:3.0:1789115521.400139:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288335488 00000100:00100000:3.0:1789115521.400327:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:3.0:1789115521.400338:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc085e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:11562:x1876023288335488:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1789115521.400357:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115521.400375:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3cfa expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.400434:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000597d4772/0xa47abda6516d3b2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cf3 expref: 7 pid: 6885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.400443:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115521.400447:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115521.400453:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.400486:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000597d4772/0xa47abda6516d3b2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cf3 expref: 7 pid: 6885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.400500:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000597d4772/0xa47abda6516d3b2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cf3 expref: 7 pid: 6885 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115521.400512:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3c12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1876023308269312:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115521.400608:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a8e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789115521.405197:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3c12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1876023308269312:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115521.405520:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:3.0:1789115521.405731:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.405776:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb800, rc 0) 00000100:00100000:3.0:1789115521.405833:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc085e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+7:11562:x1876023288335488:12345-192.168.203.31@tcp:101:bash.0 Request processed in 5497us (7347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115521.405843:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:1.0:1789115521.406345:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288335616 00000100:00100000:1.0:1789115521.406353:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288335616 00010000:00010000:1.0:1789115521.406408:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000597d4772/0xa47abda6516d3b2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cf3 expref: 7 pid: 6885 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115521.406433:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:1.0:1789115521.406442:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288335616:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115521.406453:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115521.406472:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000597d4772/0xa47abda6516d3b2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cf3 expref: 7 pid: 6885 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.406492:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000597d4772/0xa47abda6516d3b2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cf3 expref: 7 pid: 6885 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.406513:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000597d4772/0xa47abda6516d3b2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cf3 expref: 7 pid: 6885 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.406526:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115521.406530:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115521.406538:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.406547:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.406588:0:6713:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115521.406600:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d5e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6713:1876023308269440:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789115521.406657:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd04b30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789115521.412047:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d5e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6713:1876023308269440:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789115521.412075:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115521.412300:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288335616:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 5857us (6780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115521.412311:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:2.0:1789115521.414997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115521.415102:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288335872 00000100:00100000:1.0:1789115521.415110:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288335872 00000100:00100000:1.0:1789115521.415181:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:1.0:1789115521.415190:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+18:11562:x1876023288335872:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:1.0:1789115521.415573:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+19:11562:x1876023288335872:12345-192.168.203.31@tcp:35:bash.0 Request processed in 382us (581us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789115521.415581:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1789115521.496896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115521.496994:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288336128 00000100:00100000:1.0:1789115521.497003:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288336128 00000100:00100000:1.0:1789115521.497057:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:1.0:1789115521.497066:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+19:11572:x1876023288336128:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115521.497107:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115521.497128:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d01 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115521.497303:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1789115521.497436:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b39 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d01 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.497448:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:1.0:1789115521.497451:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789115521.497455:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d01 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.497469:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7800, rc 0) 00000100:00100000:1.0:1789115521.497609:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+20:11572:x1876023288336128:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 543us (725us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1789115521.497642:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:3.0:1789115521.504528:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115521.505297:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288336384 00000100:00100000:1.0:1789115521.505308:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288336384 00000100:00100000:1.0:1789115521.505369:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:1.0:1789115521.505515:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+20:11572:x1876023288336384:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1789115521.505778:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+21:11572:x1876023288336384:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 398us (1257us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789115521.505787:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:2.0:1789115521.591534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115521.591755:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288336512 00000100:00100000:1.0:1789115521.591764:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288336512 00000100:00100000:1.0:1789115521.591923:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:1.0:1789115521.591935:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+21:11578:x1876023288336512:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115521.591960:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115521.591980:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d08 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.592044:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.592058:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.592069:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115521.592144:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1789115521.592148:0:8213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115521.592186:0:8213:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.592210:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d08 expref: 23 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.592226:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d08 expref: 22 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.592360:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115521.592363:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789115521.592367:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7400, rc 0) 00000100:00100000:1.0:1789115521.592464:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+22:11578:x1876023288336512:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 531us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115521.592471:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:2.0:1789115521.598413:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115521.598503:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288336768 00000100:00100000:0.0:1789115521.598514:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288336768 00000100:00100000:0.0:1789115521.598586:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:0.0:1789115521.598596:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+22:11578:x1876023288336768:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115521.598616:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115521.598638:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3b55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d0f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.598727:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3b5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.598741:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.598764:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115521.598777:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789115521.600461:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3b55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d0f expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.600490:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d0f expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.600500:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:0.0:1789115521.600504:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115521.600507:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e000, rc 0) 00000100:00100000:0.0:1789115521.600632:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+24:11578:x1876023288336768:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2035us (2228us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1789115521.600641:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:2.0:1789115521.610457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115521.610606:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115521.611165:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288337152 00000100:00100000:1.0:1789115521.611175:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288337152 00000100:00100000:1.0:1789115521.611239:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:1.0:1789115521.611249:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+24:11578:x1876023288337152:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115521.611274:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115521.611295:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d16 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.611418:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3b71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.611434:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.611445:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115521.611469:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789115521.611591:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d16 expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.611610:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3b71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d16 expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.611619:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:1.0:1789115521.611622:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789115521.611626:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7000, rc 0) 00000100:00100000:1.0:1789115521.611682:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+26:11578:x1876023288337152:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 434us (1075us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789115521.611689:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:0.0:1789115521.617649:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288336896 00000100:00100000:0.0:1789115521.617663:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288336896 00000100:00100000:0.0:1789115521.617794:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1789115521.617805:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+26:2350:x1876023288336896:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115521.617832:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115521.617856:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3b5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d0f expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.617873:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:0.0:1789115521.617877:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115521.617954:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+25:2350:x1876023288336896:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 150us (7506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115521.617962:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:2.0:1789115521.626013:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115521.626170:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288337280 00000100:00100000:3.0:1789115521.626178:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288337280 00000100:00100000:3.0:1789115521.626322:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:3.0:1789115521.626336:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff971a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2353:x1876023288337280:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:3.0:1789115521.626403:0:6885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3b7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.626425:0:6885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.626434:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115521.626439:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789115521.626444:0:6885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3b7f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.626480:0:6885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.626494:0:6885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 6 pid: 6697 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115521.626530:0:6885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3c0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6885:1876023308269568:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115521.626741:0:6885:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a8e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789115521.630142:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115521.630705:0:6885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3c0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6885:1876023308269568:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789115521.630729:0:6885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3b7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115521.630862:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288337408 00000100:00100000:0.0:1789115521.630869:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288337408 00002000:00100000:0.0:1789115521.630920:0:6702:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8dfcff971e00 x1876023288337408/t0(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:337/0 lens 504/0 e 0 to 0 dl 1789115532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789115521.630944:0:6702:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcff971e00 with x1876023288337408 ext(0->12) 00010000:00010000:0.0:1789115521.630952:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 7 pid: 6697 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.630973:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 7 pid: 6697 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789115521.630980:0:6702:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dfcff971e00 00000100:00100000:0.0:1789115521.631002:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1789115521.631011:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff971e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6dbf7574-92fb-4b89-af78-41319f924699+7:2352:x1876023288337408:12345-192.168.203.31@tcp:4:lfs.0 00000100:00100000:0.0:1789115521.632310:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff971e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6dbf7574-92fb-4b89-af78-41319f924699+9:2352:x1876023288337408:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 1292us (2171us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789115521.632322:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00002000:00100000:0.0:1789115521.632331:0:6702:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8dfcff971e00 x1876023288337408/t4294967305(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:337/0 lens 504/448 e 0 to 0 dl 1789115532 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789115521.632341:0:6702:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcff971e00 with x1876023288337408 ext(0->12) 00010000:00010000:0.0:1789115521.632348:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 9 pid: 6697 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.632379:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 9 pid: 6697 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789115521.632405:0:6702:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dfcff971e00 00000100:00100000:2.0:1789115521.637013:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115521.637195:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288337536 00000100:00100000:0.0:1789115521.637205:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288337536 00010000:00010000:0.0:1789115521.637303:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 9 pid: 6697 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115521.637473:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:0.0:1789115521.637484:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff973840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+9:2353:x1876023288337536:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115521.637498:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789115521.637517:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789115521.637520:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789115520 00002000:00010000:0.0:1789115521.637523:0:5835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789115520 00002000:00010000:0.0:1789115521.637525:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789115520 00010000:00010000:0.0:1789115521.637531:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 9 pid: 6697 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.637554:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 9 pid: 6697 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.637586:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000963b3c93/0xa47abda6516d3b32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cfa expref: 9 pid: 6697 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.637620:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789115521.637625:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789115521.637630:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3b7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.637640:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3b7f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.637675:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115521.637718:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff973840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288337536:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 237us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115521.637726:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00010000:00010000:3.0:1789115521.637787:0:6885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3b7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.637796:0:6885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3b7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.638667:0:6885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3b7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.638681:0:6885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3b7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.638689:0:6885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3b7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.638697:0:6885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115521.638701:0:6885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3b7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.638726:0:6885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3b7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.638740:0:6885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3b7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.638748:0:6885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3b7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115521.638834:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff971a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288337280:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 12499us (12827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115521.638843:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1789115521.642524:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115521.642728:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288337792 00000100:00100000:1.0:1789115521.642737:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288337792 00000100:00100000:1.0:1789115521.642875:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:1.0:1789115521.642888:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88a7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+25:11578:x1876023288337792:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:1.0:1789115521.642948:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3b71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d16 expref: 25 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789115521.643195:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1789115521.643308:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1789115521.644333:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1789115521.644669:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.644687:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3b1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cec expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.644702:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.644738:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cec expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.644752:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cec expref: 29 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115521.644766:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1876023308269696:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115521.644948:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789115521.648138:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1876023308269696:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115521.648169:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115521.649470:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115521.649923:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288337920 00000100:00100000:3.0:1789115521.649932:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288337920 00010000:00010000:3.0:1789115521.649970:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cec expref: 30 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115521.650072:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:0.0:1789115521.650097:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff973480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+30:2352:x1876023288337920:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115521.650116:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115521.650124:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cec expref: 30 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.650138:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cec expref: 30 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.650160:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3b1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cec expref: 30 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.650174:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:0.0:1789115521.650192:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.650201:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.650208:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.650241:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115521.650297:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff973480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+29:2352:x1876023288337920:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 205us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115521.650306:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00010000:00010000:1.0:1789115521.650313:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.650417:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789115521.650686:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789115521.651219:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1789115521.651950:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876023308269824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789115521.652006:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115521.652103:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115521.652290:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308269824 00000100:00100000:2.0:1789115521.652298:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308269824 00000100:00100000:2.0:1789115521.652414:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789115521.652424:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1876023308269824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789115521.652514:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1876023308269824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 92us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115521.652521:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789115521.652630:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876023308269824:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789115521.653231:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1789115521.653298:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09cb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876023308269952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789115521.653337:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115521.653368:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcda97b840 going to sleep for 11 seconds 00000100:00080000:1.0:1789115521.653883:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789115521.654918:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308269952 00000100:00100000:2.0:1789115521.654928:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308269952 00000100:00100000:2.0:1789115521.654976:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789115521.654987:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1876023308269952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789115521.655539:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1876023308269952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 553us (2200us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789115521.655559:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789115521.655630:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09cb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876023308269952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789115521.655700:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1789115521.655751:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.655760:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.655767:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.655772:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115521.655788:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.655796:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.655811:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:0.0:1789115521.655815:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789115521.655819:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.655826:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3b86 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789115521.656002:0:5853:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789115521.656072:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1789115521.656096:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338868712555ns, next at 339868710278ns, rc = 0 00000001:00080000:0.0:1789115521.656101:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1789115521.656130:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044f600) 00010000:00010000:0.0:1789115521.656133:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789115521.656138:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3b71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d16 expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115521.656355:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88a7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+32:11578:x1876023288337792:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 13469us (13838us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1789115521.656364:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000020:00080000:0.0:1789115521.656368:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789115521.659162:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115521.659355:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288338048 00000100:00100000:0.0:1789115521.659365:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288338048 00000100:00100000:1.0:1789115521.659458:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:1.0:1789115521.659471:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff972d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+32:11578:x1876023288338048:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115521.659497:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115521.659527:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3b8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d1d expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.659574:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3b8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d1d expref: 33 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.659584:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3b8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d1d expref: 33 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.659595:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115521.659597:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789115521.659600:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7200, rc 0) 00000100:00100000:1.0:1789115521.659645:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff972d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+33:11578:x1876023288338048:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 178us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115521.659653:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:2.0:1789115521.669645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115521.669739:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288338304 00000100:00100000:3.0:1789115521.669749:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288338304 00000100:00100000:3.0:1789115521.669801:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1789115521.669811:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+33:11578:x1876023288338304:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1789115521.670027:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+34:11578:x1876023288338304:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 207us (381us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1789115521.670036:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00010000:00010000:0.0:1789115521.764196:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115521.766578:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115521.766657:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288338560 00000100:00100000:3.0:1789115521.766671:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288338560 00000100:00100000:3.0:1789115521.766724:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:3.0:1789115521.766734:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+34:11588:x1876023288338560:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789115521.766870:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115521.766891:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d3b94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d24 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115521.767132:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1789115521.767413:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d3b94 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d24 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.767429:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:3.0:1789115521.767433:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789115521.767438:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d3b94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d24 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.767468:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ea000, rc 0) 00000100:00100000:3.0:1789115521.767530:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+35:11588:x1876023288338560:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 797us (1078us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1789115521.767537:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 149 00000001:00080000:0.0:1789115521.769791:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967431 is committed 00000004:00080000:0.0:1789115521.769801:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789115521.769817:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dfcd1241600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789115521.769820:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcffd00600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcd12419c0 00000020:00080000:0.0:1789115521.769822:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcffd00800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcfc3b8c00 00000001:00080000:0.0:1789115521.769849:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967432 is committed 00000020:00080000:0.0:1789115521.769942:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1789115521.770038:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789115521.770051:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308270080:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789115521.770122:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115521.770170:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115521.770188:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288338688 00000100:00100000:0.0:1789115521.770188:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308270080 00000100:00100000:2.0:1789115521.770194:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288338688 00000100:00100000:0.0:1789115521.770194:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308270080 00000100:00100000:2.0:1789115521.770230:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:0.0:1789115521.770230:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789115521.770238:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+17:11588:x1876023288338688:12345-192.168.203.31@tcp:34:lfs.0 00000100:00100000:0.0:1789115521.770238:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308270080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789115521.770261:0:6698:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1789115521.770291:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3bc80, atime: 0x6aa3bc80, ctime: 0x6aa3bc80, blocks: 0x1 00010000:00010000:0.0:1789115521.770298:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3ba2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770299:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3ba9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.770311:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1789115521.770313:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.770316:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115521.770321:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3ba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770325:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.770332:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3ba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770337:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3bb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770344:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770350:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.770351:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3ba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.770358:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3ba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.770373:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789115521.770644:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3bb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770653:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770661:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789115521.770697:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770706:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770721:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3ba9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770727:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115521.770730:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1876023308270080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 493us (607us total) trans 4294967307 rc 0/0 00010000:00010000:2.0:1789115521.770733:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115521.770738:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115521.770738:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1789115521.770745:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3ba9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770756:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:2.0:1789115521.770759:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115521.770762:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789115521.770763:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3ba9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.770767:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3ba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770770:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3ba9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.770775:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e400 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115521.770778:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3ba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770782:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.770786:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3ba2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770787:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770794:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770798:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacca00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115521.770798:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3ba2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770805:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.770805:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d3ba2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770812:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770818:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcc5118700) 00010000:00010000:2.0:1789115521.770821:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115521.770823:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115521.770824:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3bb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115521.770824:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115521.770826:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115521.770830:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770840:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770845:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3bb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770850:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789115521.770851:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dfcfc09e580/2, rc 0, transno 4294967307 00010000:00010000:2.0:1789115521.770855:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacd200 already unused, calling callback (ffffffffc21494f0) 00000100:00100000:0.0:1789115521.770856:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308270080:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789115521.770858:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770863:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770870:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:2.0:1789115521.770872:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115521.770880:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3bb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115521.770886:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3bb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115521.770982:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+17:11588:x1876023288338688:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 743us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115521.770987:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:2.0:1789115521.776910:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115521.777002:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288338944 00000100:00100000:1.0:1789115521.777012:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288338944 00000100:00100000:1.0:1789115521.777070:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1789115521.777090:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+17:11588:x1876023288338944:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1789115521.777585:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+18:11588:x1876023288338944:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 504us (681us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1789115521.777593:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:0.0:1789115521.816129:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115521.818290:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288339200 00000100:00100000:2.0:1789115521.818305:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288339200 00000100:00100000:3.0:1789115521.819415:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:3.0:1789115521.819427:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+18:11591:x1876023288339200:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789115521.819450:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115521.819471:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d3bbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d2b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.819544:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3bc5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.819571:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.819584:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.819599:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3bcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.819607:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.819613:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.820827:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d3bd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.820842:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d3bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.820852:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d3bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115521.820863:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789115521.820948:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.820957:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3bc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.820963:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.820975:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115521.820979:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.820986:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.820997:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:3.0:1789115521.821000:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115521.821004:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3bc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.821010:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d3bc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.821021:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.821026:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3bcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.821032:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3bcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.821037:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ebc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115521.821039:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3bcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.821045:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3bcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.821060:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcf2157300) 00010000:00010000:3.0:1789115521.821062:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115521.821184:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3bcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.821192:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d3bcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.821250:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d3bbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d2b expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.821264:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d3bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d2b expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115521.821271:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:3.0:1789115521.821274:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789115521.821276:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ea200, rc 0) 00000100:00100000:3.0:1789115521.821563:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+20:11591:x1876023288339200:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2136us (5442us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1789115521.821572:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:2.0:1789115521.827367:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115521.827503:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288339328 00000100:00100000:1.0:1789115521.827512:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288339328 00000100:00100000:1.0:1789115521.827577:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:1.0:1789115521.827588:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff912580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+20:11591:x1876023288339328:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1789115521.827651:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3be1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.827668:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.827680:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.827705:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.827713:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3be1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.827720:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3be1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.827727:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115521.827732:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3be1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.827740:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3be1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.827752:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115521.827755:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789115521.827761:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3be1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115521.827776:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3be1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115521.827894:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff912580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+20:11591:x1876023288339328:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 308us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115521.827902:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:2.0:1789115521.834774:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115521.835837:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288339584 00000100:00100000:0.0:1789115521.835846:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288339584 00000100:00100000:0.0:1789115521.835889:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1789115521.835896:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+20:11591:x1876023288339584:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1789115521.836323:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+21:11591:x1876023288339584:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 426us (1558us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789115521.836332:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1789115522.087652:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115522.087776:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288339840 00000100:00100000:1.0:1789115522.087785:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288339840 00000100:00100000:1.0:1789115522.087849:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:1.0:1789115522.087860:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+21:11622:x1876023288339840:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:1.0:1789115522.087884:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115522.087903:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3be8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d32 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.087995:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3bef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.088011:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.088023:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115522.088035:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789115522.088358:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3be8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d32 expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.088379:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3bef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d32 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.088444:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115522.088447:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115522.088450:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6a00, rc 0) 00000100:00100000:1.0:1789115522.088628:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+23:11622:x1876023288339840:12345-192.168.203.31@tcp:101:cat.0 Request processed in 769us (983us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789115522.088636:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:2.0:1789115522.099013:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115522.099170:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288339968 00000100:00100000:0.0:1789115522.099277:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115522.099431:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288340224 00000100:00100000:3.0:1789115522.099447:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288340224 00000100:00100000:1.0:1789115522.099483:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288339968 00000100:00100000:3.0:1789115522.099519:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:3.0:1789115522.099535:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+24:11622:x1876023288340224:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:1.0:1789115522.099765:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1789115522.099780:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff911680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+25:2351:x1876023288339968:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115522.099801:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789115522.099809:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+25:11622:x1876023288340224:12345-192.168.203.31@tcp:35:cat.0 Request processed in 275us (529us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789115522.099819:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00010000:00010000:1.0:1789115522.099843:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3bef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d32 expref: 25 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.099872:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115522.099878:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115522.099927:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff911680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+23:2351:x1876023288339968:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 151us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115522.099936:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:2.0:1789115522.189209:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115522.189343:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288340480 00000100:00100000:1.0:1789115522.189358:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288340480 00000100:00100000:1.0:1789115522.189459:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:1.0:1789115522.189480:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff913840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+23:11628:x1876023288340480:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1789115522.189514:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115522.189518:0:8213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789115522.189569:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3b4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d08 expref: 23 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.189594:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115522.189600:0:8213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789115522.189617:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3bfd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d39 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.191505:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.191593:0:8213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d3bd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d2b expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.191603:0:8213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.191654:0:8213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d3bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d2b expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.192305:0:8213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d3bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d2b expref: 23 pid: 5852 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115522.192322:0:8213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308270208:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115522.192476:0:8213:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519480 going to sleep for 11 seconds 00000100:00100000:3.0:1789115522.204201:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115522.204358:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288340608 00000100:00100000:2.0:1789115522.204374:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288340608 00000100:00100000:1.0:1789115522.204491:0:8213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308270208:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115522.204531:0:8213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.204991:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d3bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d2b expref: 24 pid: 5852 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115522.205185:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:2.0:1789115522.205209:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+24:2352:x1876023288340608:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115522.205230:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115522.205239:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d3bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d2b expref: 24 pid: 5852 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.205252:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d3bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d2b expref: 24 pid: 5852 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.205319:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d3bd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d2b expref: 24 pid: 5852 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.205339:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:2.0:1789115522.205345:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.205355:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.205363:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.205438:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789115522.205489:0:8213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.205501:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115522.205527:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+23:2352:x1876023288340608:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 330us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115522.205538:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000004:00200000:1.0:1789115522.209092:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789115522.210427:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3bfd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d39 expref: 24 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.210453:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d39 expref: 23 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.210461:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115522.210464:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789115522.210467:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6800, rc 0) 00000100:00100000:1.0:1789115522.210539:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff913840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+23:11628:x1876023288340480:12345-192.168.203.31@tcp:101:dd.0 Request processed in 21063us (21346us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789115522.210549:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:3.0:1789115522.214370:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115522.214495:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288340864 00000100:00100000:2.0:1789115522.214509:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288340864 00000100:00100000:2.0:1789115522.214595:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:2.0:1789115522.214607:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+23:11628:x1876023288340864:12345-192.168.203.31@tcp:36:dd.0 00010000:00010000:2.0:1789115522.215023:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd600/0xa47abda6516d3c12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.215045:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd600/0xa47abda6516d3c12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.215058:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd600/0xa47abda6516d3c12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789115522.215156:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1789115522.215188:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bd83e655 reply state 0000000055f2e4b9 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd600/0xa47abda6516d3c12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115522.215209:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789115522.215353:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+26:11628:x1876023288340864:12345-192.168.203.31@tcp:36:dd.0 Request processed in 746us (989us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789115522.215361:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 155 00000020:00080000:2.0:1789115522.215368:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789115522.218345:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd600/0xa47abda6516d3c12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.218361:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd600/0xa47abda6516d3c12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.218367:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd600/0xa47abda6516d3c12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.218372:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacd600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115522.218376:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd600/0xa47abda6516d3c12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.218416:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd600/0xa47abda6516d3c12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.218437:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:2.0:1789115522.218441:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115522.218447:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd600/0xa47abda6516d3c12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.218539:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd600/0xa47abda6516d3c12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115522.422660:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115522.425146:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288340992 00000100:00100000:2.0:1789115522.425169:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288340992 00000100:00100000:2.0:1789115522.425275:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:2.0:1789115522.425288:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+25:11642:x1876023288340992:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:2.0:1789115522.425325:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115522.425352:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd600/0xa47abda6516d3c19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d40 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.425496:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3c20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.425515:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3c20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.425528:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3c20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.425547:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3c27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.425555:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.425562:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.429408:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3c2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.429455:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d39 expref: 26 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.429481:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3c2e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.429539:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d39 expref: 26 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.429560:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d39 expref: 26 pid: 8213 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115522.429578:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff911680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308270336:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115522.429725:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcedacfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789115522.437116:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115522.437299:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288341248 00000100:00100000:3.0:1789115522.437312:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288341248 00000100:00100000:3.0:1789115522.437416:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:3.0:1789115522.437428:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+27:5591:x1876023288341248:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789115522.438273:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff911680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308270336:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789115522.438307:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3c2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115522.440657:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+28:5591:x1876023288341248:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 3211us (3534us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789115522.440674:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:0.0:1789115522.449356:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115522.449511:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288341376 00000100:00100000:2.0:1789115522.449523:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288341376 00010000:00010000:2.0:1789115522.449576:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d39 expref: 28 pid: 8213 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115522.449630:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:2.0:1789115522.449640:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+28:2352:x1876023288341376:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115522.449659:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115522.449667:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d39 expref: 28 pid: 8213 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.449703:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d39 expref: 28 pid: 8213 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.449734:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3c04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d39 expref: 28 pid: 8213 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.449755:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:2.0:1789115522.449763:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3c2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.449774:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.449782:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3c2e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.449825:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115522.449893:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+27:2352:x1876023288341376:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 252us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115522.449901:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00010000:00010000:3.0:1789115522.450426:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450447:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115522.450506:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789115522.450512:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789115522.450542:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450557:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450567:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3c20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450574:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3c20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450581:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3c20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450597:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115522.450602:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3c20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450612:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3c20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450624:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:3.0:1789115522.450627:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115522.450631:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3c20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450637:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3c20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450650:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450657:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3c27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450662:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450668:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacca00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115522.450670:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450676:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3c27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450694:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcc5118700) 00010000:00010000:3.0:1789115522.450696:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115522.450699:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3c27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450705:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3c27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450750:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd600/0xa47abda6516d3c19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d40 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450766:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3c2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d40 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.450773:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:3.0:1789115522.450776:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789115522.450778:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacd200, rc 0) 00000100:00100000:3.0:1789115522.450830:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+26:11642:x1876023288340992:12345-192.168.203.31@tcp:101:stat.0 Request processed in 25544us (28179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115522.450838:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:0.0:1789115522.556254:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115522.556622:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288341632 00000100:00100000:1.0:1789115522.556637:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288341632 00000100:00100000:1.0:1789115522.557184:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:1.0:1789115522.557201:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+26:11648:x1876023288341632:12345-192.168.203.31@tcp:36:truncate.0 00010000:00010000:1.0:1789115522.557284:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115522.557322:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d3c2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d40 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.557442:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115522.557448:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789115522.558225:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3c35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.558246:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3c35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.558259:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3c35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789115522.558320:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1789115522.558346:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000083342e26 reply state 00000000a0de0b14 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3c35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115522.558357:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789115522.559099:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+28:11648:x1876023288341632:12345-192.168.203.31@tcp:36:truncate.0 Request processed in 1897us (2854us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789115522.559112:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 157 00000020:00080000:1.0:1789115522.559119:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789115522.572708:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3c35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.572732:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3c35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.572740:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3c35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.572747:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115522.572774:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3c35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.572783:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3c35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.572805:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115522.572808:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115522.572814:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3c35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.572831:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3c35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115522.742915:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115522.743679:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288341760 00000100:00100000:1.0:1789115522.743693:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288341760 00000100:00100000:1.0:1789115522.744100:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:1.0:1789115522.744115:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+27:11662:x1876023288341760:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:1.0:1789115522.744166:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115522.744196:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3c3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d47 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.744285:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.744301:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.744314:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.744330:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.744359:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.744366:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745063:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3c51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745172:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3c51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745181:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3c51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115522.745227:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789115522.745232:0:8213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115522.745256:0:8213:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3c51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745269:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3c51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745280:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745287:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745294:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745488:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115522.745494:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745501:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745515:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115522.745519:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115522.745524:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745531:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745546:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745552:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3c4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745558:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745564:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115522.745567:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745574:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3c4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745593:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcd01ae700) 00010000:00010000:1.0:1789115522.745596:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115522.745599:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3c4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745604:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3c4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745648:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3c3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d47 expref: 29 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745664:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3c51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d47 expref: 28 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.745672:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115522.745674:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115522.745677:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6e00, rc 0) 00000100:00100000:1.0:1789115522.746368:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+28:11662:x1876023288341760:12345-192.168.203.31@tcp:101:stat.0 Request processed in 2253us (3472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115522.746379:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 158 00010000:00010000:1.0:1789115522.792735:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115522.829208:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115522.829374:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288342016 00000100:00100000:3.0:1789115522.829404:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288342016 00000100:00100000:3.0:1789115522.829470:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:3.0:1789115522.829480:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff911680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+28:11672:x1876023288342016:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789115522.829500:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115522.829521:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d3c58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d4e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115522.829798:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1789115522.829961:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d3c58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d4e expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.829975:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:3.0:1789115522.829978:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789115522.829983:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d3c58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d4e expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.829995:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ea800, rc 0) 00000100:00100000:3.0:1789115522.830059:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff911680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+29:11672:x1876023288342016:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 580us (860us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1789115522.830066:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:3.0:1789115522.837488:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115522.837567:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288342272 00000100:00100000:0.0:1789115522.837576:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288342272 00000100:00100000:0.0:1789115522.837625:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:0.0:1789115522.837633:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88a6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+29:11672:x1876023288342272:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1789115522.838015:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88a6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+30:11672:x1876023288342272:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 381us (534us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789115522.838029:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:0.0:1789115522.902372:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115522.902535:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288342528 00000100:00100000:3.0:1789115522.902544:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288342528 00000100:00100000:3.0:1789115522.902605:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:3.0:1789115522.902614:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+30:11678:x1876023288342528:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1789115522.902637:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115522.902657:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d3c66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.902767:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.902781:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3c51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d47 expref: 31 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.902803:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.902836:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3c51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d47 expref: 31 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.902849:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3c51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d47 expref: 31 pid: 8213 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115522.902862:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308270464:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115522.902946:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a8ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789115522.905852:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115522.906016:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308270464:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789115522.906040:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115522.906333:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288342656 00000100:00100000:0.0:1789115522.906340:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288342656 00010000:00010000:0.0:1789115522.906375:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3c51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d47 expref: 32 pid: 8213 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115522.906436:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1789115522.906445:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9103c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+32:2353:x1876023288342656:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115522.906459:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115522.906465:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3c51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d47 expref: 32 pid: 8213 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115522.906477:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3c51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d47 expref: 32 pid: 8213 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115522.906500:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3c51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d47 expref: 32 pid: 8213 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115522.906516:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:0.0:1789115522.906521:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115522.906530:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115522.906537:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115522.906585:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115522.906641:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9103c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+31:2353:x1876023288342656:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 197us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115522.906650:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00010000:00010000:3.0:1789115522.906796:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.906803:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115522.906821:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789115522.906963:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d3c66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d55 expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.906979:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d55 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.906996:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:3.0:1789115522.907000:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789115522.907002:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb400, rc 0) 00000100:00100000:3.0:1789115522.907040:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+31:11678:x1876023288342528:12345-192.168.203.31@tcp:101:bash.0 Request processed in 4427us (4676us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789115522.907047:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:2.0:1789115522.911458:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115522.911543:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288342912 00000100:00100000:3.0:1789115522.911562:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288342912 00000100:00100000:3.0:1789115522.911614:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:3.0:1789115522.911624:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+31:11678:x1876023288342912:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:3.0:1789115522.911903:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d3c7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.911921:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d3c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.911932:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d3c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789115522.911994:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1789115522.912027:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000614e3e10 reply state 00000000e854f397 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d3c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115522.912035:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789115522.912144:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+34:11678:x1876023288342912:12345-192.168.203.31@tcp:36:bash.0 Request processed in 521us (694us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789115522.912155:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 161 00000020:00080000:3.0:1789115522.912168:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789115522.916119:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d3c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.916135:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d3c7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.916160:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d3c7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.916166:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eac00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115522.916171:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d3c7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.916179:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d3c7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.916194:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:2.0:1789115522.916198:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115522.916202:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d3c7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.916208:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d3c7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115522.918335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115522.918440:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288343040 00000100:00100000:1.0:1789115522.918449:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288343040 00000100:00100000:1.0:1789115522.918509:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:1.0:1789115522.918519:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff973840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+33:11678:x1876023288343040:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1789115522.918542:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115522.918568:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3c82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d5c expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.918663:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.918678:0:8213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d55 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.918687:0:8213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c89 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.918717:0:8213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d55 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115522.918730:0:8213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d55 expref: 34 pid: 5851 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115522.918742:0:8213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9d7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308270592:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115522.918819:0:8213:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519480 going to sleep for 11 seconds 00000100:00100000:0.0:1789115522.922223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115522.922334:0:8213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9d7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308270592:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115522.922359:0:8213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115522.922728:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288343168 00000100:00100000:2.0:1789115522.922734:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288343168 00010000:00010000:2.0:1789115522.922769:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d55 expref: 35 pid: 5851 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115522.922841:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:2.0:1789115522.922851:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+35:2352:x1876023288343168:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115522.922864:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115522.922871:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d55 expref: 35 pid: 5851 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.922901:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d55 expref: 35 pid: 5851 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.922923:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3c6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d55 expref: 35 pid: 5851 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.922937:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:2.0:1789115522.922942:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.922951:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.922959:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c89 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115522.922993:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115522.923101:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+34:2352:x1876023288343168:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 250us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115522.923109:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00010000:00010000:3.0:1789115522.923167:0:8213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.923175:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115522.923218:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789115522.923223:0:8213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789115522.923242:0:8213:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.923272:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3c82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d5c expref: 34 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.923288:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d5c expref: 33 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115522.923295:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:3.0:1789115522.923297:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789115522.923300:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7400, rc 0) 00000100:00100000:3.0:1789115522.923327:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff973840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+33:11678:x1876023288343040:12345-192.168.203.31@tcp:101:bash.0 Request processed in 4810us (5002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115522.923334:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:0.0:1789115522.928792:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115522.928998:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288343424 00000100:00100000:3.0:1789115522.929008:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288343424 00000100:00100000:3.0:1789115522.929180:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:3.0:1789115522.929192:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+33:11678:x1876023288343424:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:3.0:1789115522.933775:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+34:11678:x1876023288343424:12345-192.168.203.31@tcp:35:bash.0 Request processed in 4573us (4978us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789115522.933802:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1789115523.004583:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115523.004680:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288343680 00000100:00100000:3.0:1789115523.004690:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288343680 00000100:00100000:3.0:1789115523.004771:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:3.0:1789115523.004782:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+34:11688:x1876023288343680:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789115523.004805:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115523.004825:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d3c90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d63 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115523.005080:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1789115523.005255:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d3c90 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d63 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.005270:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:3.0:1789115523.005273:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789115523.005278:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d3c90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d63 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.005290:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ea800, rc 0) 00000100:00100000:3.0:1789115523.005357:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+35:11688:x1876023288343680:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 577us (783us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1789115523.005365:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00080000:1.0:1789115523.005643:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115523.008665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115523.008708:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288343808 00000100:00100000:3.0:1789115523.008717:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288343808 00000100:00100000:3.0:1789115523.008942:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:3.0:1789115523.008954:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+35:11688:x1876023288343808:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:3.0:1789115523.009045:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3c9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009061:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009093:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009110:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3ca5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009116:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009123:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009637:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009648:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009655:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789115523.009693:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009704:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009720:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3c9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009727:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3c9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009743:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115523.009748:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3c9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009764:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3c9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009776:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:3.0:1789115523.009779:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115523.009783:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3c9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009790:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3c9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009802:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009808:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3ca5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009813:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009818:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115523.009827:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009834:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3ca5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009845:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcf2157300) 00010000:00010000:3.0:1789115523.009849:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115523.009852:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3ca5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009856:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3ca5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009872:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009877:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009883:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009887:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115523.009889:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009895:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009902:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:3.0:1789115523.009904:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115523.009913:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.009919:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115523.010006:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+35:11688:x1876023288343808:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 1053us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115523.010014:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:2.0:1789115523.013705:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115523.013896:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288344064 00000100:00100000:1.0:1789115523.013904:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288344064 00000100:00100000:1.0:1789115523.013953:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1789115523.013962:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+35:11688:x1876023288344064:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1789115523.014444:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+36:11688:x1876023288344064:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 480us (745us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1789115523.014453:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:0.0:1789115523.055101:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115523.055190:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288344320 00000100:00100000:3.0:1789115523.055200:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288344320 00000100:00100000:3.0:1789115523.055258:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:3.0:1789115523.055268:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+36:11691:x1876023288344320:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789115523.055292:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115523.055321:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d6a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.055424:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3cba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.055437:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.055452:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.055467:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.055473:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.055494:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.055878:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d3cc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.055888:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d3cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.055896:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d3cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115523.055905:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789115523.055979:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.055987:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3cba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.055994:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3cba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.055999:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115523.056003:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3cba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.056010:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3cba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.056020:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:3.0:1789115523.056023:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115523.056034:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3cba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.056040:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3cba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.056051:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.056057:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.056063:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.056079:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115523.056082:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.056274:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.056283:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcf2157300) 00010000:00010000:3.0:1789115523.056285:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115523.056289:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.056294:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.056426:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d6a expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.056453:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d3cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d6a expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.056460:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:3.0:1789115523.056463:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789115523.056465:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ea800, rc 0) 00000100:00100000:3.0:1789115523.056525:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+38:11691:x1876023288344320:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1258us (1439us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1789115523.056533:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:0.0:1789115523.059529:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115523.059713:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288344448 00000100:00100000:1.0:1789115523.059722:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288344448 00000100:00100000:0.0:1789115523.059730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115523.059877:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288344576 00000100:00100000:2.0:1789115523.059882:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288344576 00000100:00100000:1.0:1789115523.059957:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:2.0:1789115523.060084:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1789115523.060108:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+39:2353:x1876023288344576:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115523.060124:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115523.060148:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d3cc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d6a expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.060178:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:2.0:1789115523.060183:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115523.060243:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+38:2353:x1876023288344576:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 136us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115523.060250:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1789115523.060490:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+37:11691:x1876023288344448:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1789115523.060548:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.060562:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.060572:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.060596:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.060602:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3cd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.060609:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.060614:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115523.060618:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.060625:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.060643:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115523.060645:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789115523.060649:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3cd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.060654:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3cd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115523.060690:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+37:11691:x1876023288344448:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 725us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115523.060697:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:0.0:1789115523.062986:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115523.063974:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288344832 00000100:00100000:1.0:1789115523.063986:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288344832 00000100:00100000:1.0:1789115523.064059:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:1.0:1789115523.064077:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+37:11691:x1876023288344832:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1789115523.064305:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+38:11691:x1876023288344832:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 237us (1325us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789115523.064313:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1789115523.196464:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115523.196577:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288345088 00000100:00100000:1.0:1789115523.196587:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288345088 00000100:00100000:1.0:1789115523.196654:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:1.0:1789115523.196664:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+38:11709:x1876023288345088:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:1.0:1789115523.196688:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115523.196709:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3cdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d71 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.196821:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3ce4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.196849:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.196860:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115523.196873:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789115523.197005:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3cdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d71 expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.197022:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d71 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.197030:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115523.197033:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789115523.197036:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6c00, rc 0) 00000100:00100000:1.0:1789115523.197102:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+40:11709:x1876023288345088:12345-192.168.203.31@tcp:101:cat.0 Request processed in 440us (646us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789115523.197109:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:0.0:1789115523.225468:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115523.226132:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288345216 00000100:00100000:3.0:1789115523.226142:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288345216 00000100:00100000:3.0:1789115523.226211:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:3.0:1789115523.226222:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+40:11710:x1876023288345216:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789115523.226245:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115523.226265:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.226326:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.226339:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.226350:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115523.226557:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1789115523.226566:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789115523.226641:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.226668:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d3cf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d78 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.226684:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d78 expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.226692:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:3.0:1789115523.226695:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789115523.226698:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb200, rc 0) 00000100:00100000:3.0:1789115523.226761:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+41:11710:x1876023288345216:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 541us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115523.226769:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:0.0:1789115523.231996:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115523.232291:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288345600 00000100:00100000:1.0:1789115523.232300:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288345600 00000100:00100000:1.0:1789115523.232353:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:1.0:1789115523.232363:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+41:11710:x1876023288345600:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1789115523.233677:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+42:11710:x1876023288345600:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 1309us (1682us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789115523.233689:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:0.0:1789115523.237516:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115523.238797:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288345728 00000100:00100000:1.0:1789115523.238823:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288345728 00000100:00100000:1.0:1789115523.238895:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1789115523.238905:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+42:11710:x1876023288345728:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:1.0:1789115523.238921:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789115523.238944:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3c89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d5c expref: 42 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.238967:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3ce4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d71 expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.238980:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3b8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d1d expref: 40 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115523.238990:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115523.239000:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115523.239063:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+39:11710:x1876023288345728:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 159us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115523.239080:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:0.0:1789115523.242415:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115523.242566:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288345856 00000100:00100000:3.0:1789115523.242576:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288345856 00000100:00100000:3.0:1789115523.242631:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 169 00000100:00100000:3.0:1789115523.242641:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+39:11710:x1876023288345856:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:3.0:1789115523.242755:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3d00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.242771:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3d00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115523.242784:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3d00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789115523.243090:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789115523.243175:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+39:11710:x1876023288345856:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 535us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115523.243184:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 169 00000100:00100000:3.0:1789115523.266771:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115523.268038:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288345984 00000100:00100000:2.0:1789115523.268051:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288345984 00000100:00100000:2.0:1789115523.268136:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 170 00000100:00100000:2.0:1789115523.268146:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+39:11712:x1876023288345984:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789115523.268166:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115523.268185:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d3d07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d7f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.268250:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3d0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.268265:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.268276:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.268291:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.268297:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.268320:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.268871:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d3d1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.268882:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d3d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.268891:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d3d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115523.268924:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789115523.268928:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789115523.268946:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d3d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.268957:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d3d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.268964:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.268970:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3d0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.268976:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.268982:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedaccc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115523.268986:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.269000:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3d0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.269012:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:2.0:1789115523.269015:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115523.269020:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3d0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.269026:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedaccc00/0xa47abda6516d3d0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.269038:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.269044:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.269049:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.269054:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115523.269056:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.269062:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.269080:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcc5118b00) 00010000:00010000:2.0:1789115523.269082:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115523.269148:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.269165:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.269198:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacce00/0xa47abda6516d3d07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d7f expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.269210:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d3d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d7f expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115523.269217:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcf2157300) 00010000:00010000:2.0:1789115523.269219:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789115523.269222:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacd000, rc 0) 00000100:00100000:2.0:1789115523.269287:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+40:11712:x1876023288345984:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1142us (2524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115523.269294:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 170 00000100:00100000:0.0:1789115523.573272:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115523.573315:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115523.573341:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115523.573374:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115523.573557:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288346368 00000100:00100000:2.0:1789115523.573566:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288346368 00000100:00100000:3.0:1789115523.573602:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288346240 00000100:00100000:3.0:1789115523.573609:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288346240 00000100:00100000:2.0:1789115523.573635:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:2.0:1789115523.573647:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288346368:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115523.573652:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:3.0:1789115523.573665:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2352:x1876023288346240:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:0.0:1789115523.573729:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789115523.573734:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789115523.573892:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288346368:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 248us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115523.573900:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:1.0:1789115523.574833:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288346112 00000100:00100000:1.0:1789115523.574843:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288346112 00000100:00100000:1.0:1789115523.574900:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 324 00000100:00100000:1.0:1789115523.574909:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2352:x1876023288346112:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115523.575915:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2352:x1876023288346240:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 2247us (2566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115523.575925:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:1.0:1789115523.577927:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2352:x1876023288346112:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 3008us (4653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115523.577939:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 324 00000100:00100000:1.0:1789115523.577994:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288346496 00000100:00100000:1.0:1789115523.578001:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288346496 00000100:00100000:1.0:1789115523.578087:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:1.0:1789115523.578098:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2352:x1876023288346496:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115523.578144:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2352:x1876023288346496:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 49us (4769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115523.578150:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00080000:2.0:1789115523.578739:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115523.752803:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308270720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789115523.752872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115523.752939:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308270720 00000100:00100000:2.0:1789115523.752945:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308270720 00000100:00100000:2.0:1789115523.752999:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789115523.753007:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876023308270720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789115523.753042:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115523.753104:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876023308270720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115523.753111:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1789115523.753130:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789115523.753161:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308270720:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789115523.834743:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789115524.005597:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789115524.005606:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789115524.005914:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789115524.005921:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789115524.006032:0:12072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf5184b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876023308270848:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789115524.006201:0:12072:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519780 going to sleep for 11 seconds 00000100:00100000:2.0:1789115524.013184:0:12072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf5184b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876023308270848:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789115524.013195:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115524.013336:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288346624 00000100:00100000:3.0:1789115524.013343:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288346624 00000100:00100000:3.0:1789115524.013800:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:3.0:1789115524.013820:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8853c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+40:11723:x1876023288346624:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789115524.013849:0:8213:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789115524.013954:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8853c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+40:11723:x1876023288346624:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 144us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115524.013962:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:0.0:1789115524.016975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115524.017011:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288346752 00000100:00100000:0.0:1789115524.017019:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288346752 00000100:00100000:0.0:1789115524.017079:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:0.0:1789115524.017089:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+40:11723:x1876023288346752:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789115524.017163:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3d23 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017181:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3d23 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017194:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3d23 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017249:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d2a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017258:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017265:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017295:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3d31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017304:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017313:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115524.017351:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789115524.017356:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115524.017367:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017379:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3d23 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017413:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3d23 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017420:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3d23 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017427:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115524.017432:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3d23 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017440:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3d23 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017452:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:0.0:1789115524.017455:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115524.017460:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3d23 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017467:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3d23 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017478:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017484:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d2a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017491:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d2a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017496:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115524.017505:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d2a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017512:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d2a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017519:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8dfcd044f900) 00010000:00010000:0.0:1789115524.017521:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115524.017524:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d2a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017529:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d2a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017542:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017547:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3d31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017553:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017558:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ea00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115524.017561:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017567:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017574:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcf2157300) 00010000:00010000:0.0:1789115524.017576:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115524.017587:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3d31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.017593:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3d31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115524.017665:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+40:11723:x1876023288346752:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 576us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115524.017675:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:3.0:1789115524.023138:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115524.023659:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288347008 00000100:00100000:2.0:1789115524.023669:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288347008 00000100:00100000:2.0:1789115524.023862:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:2.0:1789115524.023873:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+40:11723:x1876023288347008:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789115524.023893:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115524.023913:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3d38 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d86 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.024003:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.024027:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.024038:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115524.024071:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789115524.024161:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.024169:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.024176:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.024181:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacd400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115524.024185:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.024192:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.024203:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcf2157300) 00010000:00010000:2.0:1789115524.024207:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789115524.024211:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.024218:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.024255:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3d38 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d86 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.024266:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:2.0:1789115524.024268:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789115524.024279:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacda00/0xa47abda6516d3d38 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d86 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.024289:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacda00, rc 0) 00000100:00100000:2.0:1789115524.024349:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+41:11723:x1876023288347008:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 478us (1217us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1789115524.024357:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:2.0:1789115524.037687:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115524.037785:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288347136 00000100:00100000:0.0:1789115524.037794:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288347136 00000100:00100000:0.0:1789115524.037853:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:0.0:1789115524.037863:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+41:11723:x1876023288347136:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789115524.037897:0:5850:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789115524.038001:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+41:11723:x1876023288347136:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 138us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115524.038009:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:0.0:1789115524.045723:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115524.045800:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288347392 00000100:00100000:3.0:1789115524.045809:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288347392 00000100:00100000:3.0:1789115524.045864:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:3.0:1789115524.045873:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+41:11723:x1876023288347392:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789115524.045894:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115524.045897:0:8213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789115524.045921:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d3cf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d78 expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.045956:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:3.0:1789115524.045961:0:8213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789115524.045975:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d3d4d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d8d expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789115524.046633:0:8213:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789115524.046868:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3d54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.046883:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.046894:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.046956:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eac00/0xa47abda6516d3d4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d8d expref: 43 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.046978:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3d54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d8d expref: 42 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.046986:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dfcf2157700) 00010000:00010000:3.0:1789115524.046989:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789115524.046992:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ebe00, rc 0) 00000100:00100000:3.0:1789115524.047056:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+42:11723:x1876023288347392:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1183us (1341us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789115524.047074:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:3.0:1789115524.050211:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115524.050834:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288347648 00000100:00100000:1.0:1789115524.050844:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288347648 00000100:00100000:1.0:1789115524.050916:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:1.0:1789115524.050927:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+42:11723:x1876023288347648:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789115524.050981:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115524.051006:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d3d54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d8d expref: 42 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.051814:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dfcf2157700) 00010000:00010000:1.0:1789115524.051826:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789115524.051849:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3d62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.051863:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3d62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.051886:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3d62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.051902:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3d69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x98d73d72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.051909:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3d69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x98d73d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.051915:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3d69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x98d73d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.052788:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3d62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.052800:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3d62 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.052806:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3d62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.052813:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115524.052817:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3d62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.052824:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3d62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.052836:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115524.052839:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115524.052844:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3d62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.052857:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3d62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.052870:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3d69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x98d73d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.052877:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3d69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x98d73d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.052883:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3d69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x98d73d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.052889:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115524.052893:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3d69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x98d73d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.052900:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3d69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x98d73d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.052910:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x98d73d72 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115524.052913:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115524.052916:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3d69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x98d73d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.052922:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3d69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x98d73d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115524.053799:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+41:11723:x1876023288347648:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 2867us (3587us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789115524.053810:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:3.0:1789115524.062752:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115524.062829:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288347776 00000100:00100000:0.0:1789115524.062838:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288347776 00000100:00100000:0.0:1789115524.062888:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 177 00000100:00100000:0.0:1789115524.062897:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+41:11723:x1876023288347776:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115524.062916:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115524.062936:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3d70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d94 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.063008:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.063048:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.063071:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.063168:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3d70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d94 expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.063185:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d94 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.063195:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dfcd044f900) 00010000:00010000:0.0:1789115524.063198:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789115524.063201:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e000, rc 0) 00000100:00100000:0.0:1789115524.063292:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+42:11723:x1876023288347776:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 396us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115524.063299:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 177 00000100:00100000:0.0:1789115524.070710:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115524.070946:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288348032 00000100:00100000:2.0:1789115524.070955:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288348032 00000100:00100000:2.0:1789115524.071007:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:2.0:1789115524.071018:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+42:11723:x1876023288348032:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789115524.071103:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.071120:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.071131:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789115524.072131:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1789115524.072144:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341284761181ns, next at 342284758856ns, rc = 0 00000004:00010000:3.0:1789115524.073727:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000456b7629 reply state 0000000025771f81 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115524.073743:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789115524.073865:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+44:11723:x1876023288348032:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 2846us (3160us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789115524.073878:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 178 00010000:00010000:2.0:1789115524.075128:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.075139:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.075143:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.075158:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacd400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115524.075161:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.075167:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d7e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.075180:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dfcd044f900) 00010000:00010000:2.0:1789115524.075182:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789115524.075185:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d7e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.075189:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115524.075738:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115524.075807:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288348160 00000100:00100000:2.0:1789115524.075813:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288348160 00000100:00100000:2.0:1789115524.075852:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:2.0:1789115524.075859:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+43:11723:x1876023288348160:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789115524.075875:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115524.075888:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3d9b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.075928:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d9b expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.075938:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d9b expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.075961:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dfcd044f900) 00010000:00010000:2.0:1789115524.075964:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789115524.075966:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacc600, rc 0) 00000100:00100000:2.0:1789115524.076032:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+44:11723:x1876023288348160:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 173us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115524.076037:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:3.0:1789115524.078472:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115524.078520:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288348288 00000100:00100000:0.0:1789115524.078528:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288348288 00000100:00100000:0.0:1789115524.078623:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:0.0:1789115524.078635:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:2350:x1876023288348288:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789115524.078968:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2350:x1876023288348288:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 335us (502us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789115524.078978:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:0.0:1789115524.081887:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115524.082770:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288348544 00000100:00100000:3.0:1789115524.082780:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288348544 00000100:00100000:3.0:1789115524.082876:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:3.0:1789115524.082886:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8824780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+44:11723:x1876023288348544:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789115524.083347:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8824780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+45:11723:x1876023288348544:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 460us (1466us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789115524.083356:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1789115524.087408:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115524.087441:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288348800 00000100:00100000:2.0:1789115524.087451:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288348800 00000100:00100000:2.0:1789115524.087503:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:2.0:1789115524.087513:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8827840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+45:11723:x1876023288348800:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789115524.087601:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8827840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+45:11723:x1876023288348800:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 90us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115524.087609:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:3.0:1789115524.093546:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115524.093586:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288348928 00000100:00100000:2.0:1789115524.093595:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288348928 00000100:00100000:2.0:1789115524.093648:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:2.0:1789115524.093658:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc332d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+45:11723:x1876023288348928:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789115524.093679:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115524.093698:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3da2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.093766:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3d93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.093780:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.093802:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115524.093838:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789115524.093856:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.093883:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd400/0xa47abda6516d3d8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3da2 expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.093897:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3da2 expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.093904:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dfcd044f900) 00010000:00010000:2.0:1789115524.093907:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789115524.093910:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacdc00, rc 0) 00000100:00100000:2.0:1789115524.093966:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc332d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+46:11723:x1876023288348928:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 309us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115524.093975:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:2.0:1789115524.096437:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115524.096524:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288349056 00000100:00100000:3.0:1789115524.096533:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288349056 00000100:00100000:3.0:1789115524.096614:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:3.0:1789115524.096625:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+7:2352:x1876023288349056:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789115524.096640:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115524.096658:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bb4094c/0xa47abda6516d3d9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3da9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789115524.096685:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3bc83, blocks: 0x1 00010000:00010000:3.0:1789115524.096711:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1789115524.096716:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115524.096726:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bb4094c/0xa47abda6516d3d9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3da9 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.096745:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001bb4094c/0xa47abda6516d3d9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3da9 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.096757:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eac00, rc 0) 00000100:00100000:3.0:1789115524.096811:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+8:2352:x1876023288349056:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 188us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115524.096819:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1789115524.100978:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115524.101023:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288349312 00000100:00100000:0.0:1789115524.101031:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288349312 00000100:00100000:0.0:1789115524.101097:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:0.0:1789115524.101106:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+46:11723:x1876023288349312:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789115524.101207:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+46:11723:x1876023288349312:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 101us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115524.101215:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:0.0:1789115524.104955:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115524.105637:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288349440 00000100:00100000:2.0:1789115524.105647:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288349440 00000100:00100000:2.0:1789115524.105692:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:2.0:1789115524.105701:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+8:11723:x1876023288349440:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789115524.105719:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115524.105853:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062cb3d91/0xa47abda6516d3da1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3db0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.105895:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001bb4094c/0xa47abda6516d3d9a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3da9 expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.105904:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115524.105908:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115524.105914:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062cb3d91/0xa47abda6516d3da1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db0 expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.105946:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001bb4094c/0xa47abda6516d3d9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3da9 expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.105958:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001bb4094c/0xa47abda6516d3d9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3da9 expref: 9 pid: 6697 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115524.105972:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1876023308270976:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115524.106056:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfc2d2c00 going to sleep for 11 seconds 00000040:00080000:3.0:1789115524.106537:0:12898:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789115524.106543:0:12898:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789115524.106577:0:12898:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789115524.106584:0:12898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789115524.110046:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115524.110899:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1876023308270976:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789115524.110932:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062cb3d91/0xa47abda6516d3da1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db0 expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.110951:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacd400, rc 0) 00000100:00100000:2.0:1789115524.111007:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+9:11723:x1876023288349440:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 5307us (6060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115524.111016:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1789115524.111198:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288349568 00000100:00100000:3.0:1789115524.111205:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288349568 00010000:00010000:3.0:1789115524.111237:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001bb4094c/0xa47abda6516d3d9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3da9 expref: 9 pid: 6697 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115524.111272:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:3.0:1789115524.111282:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8826d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+9:2353:x1876023288349568:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115524.111295:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115524.111316:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001bb4094c/0xa47abda6516d3d9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3da9 expref: 9 pid: 6697 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.111341:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001bb4094c/0xa47abda6516d3d9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3da9 expref: 9 pid: 6697 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.111363:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bb4094c/0xa47abda6516d3d9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3da9 expref: 9 pid: 6697 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.111406:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115524.111411:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115524.111418:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062cb3d91/0xa47abda6516d3da1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db0 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.111428:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062cb3d91/0xa47abda6516d3da1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db0 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.111459:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000062cb3d91/0xa47abda6516d3da1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db0 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115524.111472:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3321c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1876023308271104:192.168.203.31@tcp:105: 00000100:00100000:3.0:1789115524.111529:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a8e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789115524.119998:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3321c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1876023308271104:192.168.203.31@tcp:105: 00010000:00010000:1.0:1789115524.120023:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115524.120082:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8826d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288349568:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 8801us (10045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115524.120102:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:2.0:1789115524.128737:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115524.128993:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288349696 00000100:00100000:1.0:1789115524.129003:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288349696 00002000:00100000:1.0:1789115524.129217:0:6703:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8dfcf50ea1c0 x1876023288349696/t0(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:340/0 lens 504/0 e 0 to 0 dl 1789115535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789115524.129227:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcf50ea1c0 with x1876023288349696 ext(0->8) 00002000:00010000:1.0:1789115524.129232:0:6703:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfcf50ea1c0 00000100:00100000:1.0:1789115524.129281:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1789115524.129291:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6dbf7574-92fb-4b89-af78-41319f924699+8:2352:x1876023288349696:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789115524.129990:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6dbf7574-92fb-4b89-af78-41319f924699+10:2352:x1876023288349696:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 698us (1257us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789115524.130001:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00002000:00100000:1.0:1789115524.130009:0:6703:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8dfcf50ea1c0 x1876023288349696/t4294967314(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:340/0 lens 504/448 e 0 to 0 dl 1789115535 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789115524.130156:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcf50ea1c0 with x1876023288349696 ext(0->8) 00002000:00010000:1.0:1789115524.130162:0:6703:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfcf50ea1c0 00000100:00100000:1.0:1789115524.138120:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115524.138479:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288349824 00000100:00100000:2.0:1789115524.138488:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288349824 00000100:00100000:2.0:1789115524.138551:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:2.0:1789115524.138668:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8852940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+46:11723:x1876023288349824:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789115524.182870:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8852940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+46:11723:x1876023288349824:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 44299us (44747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115524.182884:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 183 00000001:00080000:0.0:1789115524.184549:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967446 is committed 00000020:00080000:0.0:1789115524.184573:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:0.0:1789115524.184597:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000001:00080000:0.0:1789115524.184615:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1789115524.184618:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:0.0:1789115524.185655:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1789115524.185718:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1789115524.185731:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789115524.185863:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789115524.185882:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308271232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789115524.185957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115524.186190:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308271232 00000100:00100000:1.0:1789115524.186197:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308271232 00000100:00100000:1.0:1789115524.186250:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789115524.186259:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308271232:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789115524.186443:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789115524.186447:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789115523 00002000:00010000:1.0:1789115524.186450:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789115524.186452:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789115523 -> 1789115523 00002000:00010000:1.0:1789115524.186455:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789115524.186496:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876023308271232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (538us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789115524.186503:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1789115524.186522:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789115524.186563:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dfcc8850000/2, rc 0, transno 4294967315 00000100:00100000:1.0:1789115524.186570:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308271232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789115524.188233:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115524.188566:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288349952 00000100:00100000:1.0:1789115524.188574:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288349952 00000100:00100000:1.0:1789115524.188610:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:1.0:1789115524.188617:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+10:2350:x1876023288349952:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789115524.240959:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1789115524.240998:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1789115524.241006:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1789115524.241130:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2350:x1876023288349952:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 52507us (52899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115524.241149:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:0.0:1789115524.258493:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115524.258526:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288350208 00000100:00100000:0.0:1789115524.258535:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288350208 00000100:00100000:0.0:1789115524.258594:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:0.0:1789115524.258605:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+18:11723:x1876023288350208:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789115524.258668:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115524.258694:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacdc00/0xa47abda6516d3d93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3da2 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.258777:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dfcd044f900) 00010000:00010000:0.0:1789115524.258782:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115524.258814:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3da8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.258828:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3da8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.258845:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3da8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789115524.259115:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000df42aaf3 reply state 00000000ea89b5a6 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3da8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115524.259125:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789115524.259212:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+19:11723:x1876023288350208:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 607us (726us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789115524.259220:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 184 00010000:00010000:2.0:1789115524.262561:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3da8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.262578:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3da8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.262691:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3da8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.262697:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ea00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115524.262702:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3da8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.262709:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3da8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.262726:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dfcd044f900) 00010000:00010000:2.0:1789115524.262729:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115524.262734:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3da8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.262740:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d3da8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115524.267974:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115524.268016:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288350336 00000100:00100000:0.0:1789115524.268025:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288350336 00000100:00100000:0.0:1789115524.268085:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1789115524.268096:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288350336:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789115524.268303:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789115524.268306:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789115523 -> 1789115522 00002000:00010000:0.0:1789115524.268309:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789115520 00002000:00010000:0.0:1789115524.268311:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789115523 -> 1789115522 00002000:00010000:0.0:1789115524.268320:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789115524.268370:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288350336:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 275us (403us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789115524.268379:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1789115524.274909:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115524.274940:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288350592 00000100:00100000:0.0:1789115524.274947:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288350592 00000100:00100000:0.0:1789115524.274991:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:0.0:1789115524.275000:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+18:11723:x1876023288350592:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789115524.277275:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.277296:0:8213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d94 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.277305:0:8213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.277340:0:8213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d94 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.277355:0:8213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d94 expref: 18 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115524.277368:0:8213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308271360:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115524.277474:0:8213:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8427a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789115524.289912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115524.289946:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288350720 00000100:00100000:1.0:1789115524.289954:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288350720 00010000:00010000:1.0:1789115524.289997:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d77 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d94 expref: 19 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115524.290031:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:1.0:1789115524.290041:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+19:2353:x1876023288350720:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115524.290055:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115524.290072:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d77 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d94 expref: 19 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.290085:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d94 expref: 19 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.290108:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dfcd044f900) 00010000:00010000:1.0:1789115524.290113:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.290122:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.290130:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.290150:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115524.290194:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+19:2353:x1876023288350720:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 154us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115524.290202:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00010000:00010000:0.0:1789115524.292842:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d3d77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d94 expref: 18 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115524.292876:0:8213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308271360:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115524.292896:0:8213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.292906:0:8213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.292912:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.292939:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.292946:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.292952:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.292958:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115524.292963:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.292969:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.292982:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dfcd044f900) 00010000:00010000:0.0:1789115524.292985:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789115524.292989:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.293004:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e400/0xa47abda6516d3daf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115524.293140:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+17:11723:x1876023288350592:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 18138us (18236us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789115524.293150:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:2.0:1789115524.298913:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115524.298947:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288350848 00000100:00100000:2.0:1789115524.298961:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288350848 00000100:00100000:2.0:1789115524.299006:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1789115524.299015:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+8:2352:x1876023288350848:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789115524.299055:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d3db6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.299728:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062cb3d91/0xa47abda6516d3da1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db0 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.299737:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115524.299741:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789115524.299746:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d3db6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.299779:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062cb3d91/0xa47abda6516d3da1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db0 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.300071:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062cb3d91/0xa47abda6516d3da1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db0 expref: 8 pid: 6698 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115524.300087:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf5184b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1876023308271488:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115524.300192:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd88c0540 going to sleep for 11 seconds 00000100:00100000:0.0:1789115524.312778:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf5184b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1876023308271488:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115524.312807:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d3db6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115524.313549:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115524.313628:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288350976 00000100:00100000:1.0:1789115524.313645:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288350976 00010000:00010000:1.0:1789115524.313681:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062cb3d91/0xa47abda6516d3da1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db0 expref: 9 pid: 6698 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115524.313729:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:1.0:1789115524.313738:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5184b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+9:2353:x1876023288350976:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115524.313751:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115524.313774:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062cb3d91/0xa47abda6516d3da1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db0 expref: 9 pid: 6698 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.313786:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062cb3d91/0xa47abda6516d3da1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db0 expref: 9 pid: 6698 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.313809:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062cb3d91/0xa47abda6516d3da1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db0 expref: 9 pid: 6698 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.313824:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789115524.313828:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789115524.313832:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d3db6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.313841:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d3db6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.313865:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115524.313913:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5184b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288350976:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 176us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115524.313920:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00010000:00010000:0.0:1789115524.314372:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d3db6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.314416:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d3db6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.314442:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d3db6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.314451:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d3db6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.314458:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d3db6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.314478:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc800 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115524.314482:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d3db6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.314492:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d3db6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.314505:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d3db6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.314512:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d3db6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115524.314590:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+7:2352:x1876023288350848:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 15566us (15676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115524.314599:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:1.0:1789115524.320004:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115524.320075:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288351232 00000100:00100000:0.0:1789115524.320084:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288351232 00000100:00100000:0.0:1789115524.320135:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:0.0:1789115524.320144:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+17:11723:x1876023288351232:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789115524.320212:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3dbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.320228:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3dbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.320255:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3dbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.320445:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.320457:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d9b expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.320464:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.320494:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d9b expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.320508:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d9b expref: 18 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115524.320522:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308271616:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115524.320622:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8427540 going to sleep for 11 seconds 00000100:00100000:3.0:1789115524.330959:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115524.331112:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308271616:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115524.331137:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115524.332176:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288351360 00000100:00100000:2.0:1789115524.332187:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288351360 00010000:00010000:2.0:1789115524.332224:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d9b expref: 19 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115524.332276:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:2.0:1789115524.332286:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc333480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+19:2352:x1876023288351360:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115524.332301:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115524.332307:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d9b expref: 19 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.332319:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d9b expref: 19 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.332339:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc600/0xa47abda6516d3d85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d9b expref: 19 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.332354:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dfcd044f900) 00010000:00010000:2.0:1789115524.332360:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.332368:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.332375:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.332421:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115524.332471:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc333480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+18:2352:x1876023288351360:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 186us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115524.332479:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00010000:00010000:2.0:1789115524.332506:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.332520:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789115524.333235:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1789115524.333375:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1789115524.334172:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1789115524.334284:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc1166d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1876023308271744:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789115524.334344:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115524.334377:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd88c0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789115524.335109:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308271744 00000100:00100000:3.0:1789115524.335118:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308271744 00000100:00100000:3.0:1789115524.335164:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789115524.335173:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1165e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876023308271744:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789115524.335254:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1165e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876023308271744:12345-0@lo:1000:mdt00_000.0 Request processed in 82us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115524.335262:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789115524.335900:0:5850:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1789115524.335906:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dfcc8850000, transno 4294967315 00000100:00100000:2.0:1789115524.335923:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc1166d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1876023308271744:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789115524.336451:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789115524.336521:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc1166d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1876023308271872:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789115524.336593:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115524.336620:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd88c0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789115524.336648:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308271872 00000100:00100000:2.0:1789115524.336654:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308271872 00000100:00100000:2.0:1789115524.336685:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789115524.336691:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc11643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876023308271872:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789115524.336838:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc11643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1876023308271872:12345-0@lo:1000:mdt00_000.0 Request processed in 146us (251us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789115524.336845:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789115524.336878:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc1166d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1876023308271872:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789115524.336905:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.336923:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.336930:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.336936:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c5c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115524.336940:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.336947:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.336961:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dfcd044f900) 00010000:00010000:2.0:1789115524.336964:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789115524.336968:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.336973:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3dc4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.336999:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3d00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.337005:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3d00 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.337010:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3d00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.337015:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115524.337022:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3d00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.337029:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3d00 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.337037:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcf2157300) 00010000:00010000:2.0:1789115524.337039:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789115524.337042:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3d00 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.337048:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d3d00 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.337082:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.337095:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d3d1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d7f expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.337104:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.337128:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d3d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d7f expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.337141:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d3d1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d7f expref: 21 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115524.337151:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc11670c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308272000:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115524.337207:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a8e900 going to sleep for 11 seconds 00000001:00080000:0.0:1789115524.342231:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1789115524.342247:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:2.0:1789115524.349987:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115524.351785:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288351488 00000100:00100000:1.0:1789115524.351799:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288351488 00010000:00010000:1.0:1789115524.351847:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d3d1c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d7f expref: 22 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115524.351894:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:1.0:1789115524.351904:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1164f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+22:2352:x1876023288351488:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115524.351917:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115524.351924:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d3d1c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d7f expref: 22 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.351936:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d3d1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d7f expref: 22 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.351957:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcf2157300) 00010000:00010000:1.0:1789115524.351962:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.351971:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.351977:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115524.351996:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115524.352069:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1164f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+22:2352:x1876023288351488:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 156us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115524.352077:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00010000:00010000:0.0:1789115524.353944:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd000/0xa47abda6516d3d1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3d7f expref: 21 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115524.353986:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc11670c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308272000:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115524.354008:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356703:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356718:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356732:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356738:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356745:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356750:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115524.356753:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356760:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356776:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcf2157300) 00010000:00010000:2.0:1789115524.356778:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115524.356783:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356788:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc800/0xa47abda6516d3dcb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356802:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3dbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356826:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3dbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356832:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3dbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356837:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c5e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115524.356840:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3dbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356846:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3dbd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356855:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcf2157300) 00010000:00010000:2.0:1789115524.356857:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789115524.356860:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3dbd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115524.356865:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3dbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115524.357170:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+20:11723:x1876023288351232:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 37021us (37167us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789115524.357180:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 186 00000020:00080000:2.0:1789115524.357186:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789115524.358540:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789115524.358548:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789115524.359319:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789115524.359328:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789115524.370001:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115524.370721:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288351744 00000100:00100000:2.0:1789115524.370745:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288351744 00000100:00100000:2.0:1789115524.370802:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:2.0:1789115524.370813:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88a4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+20:11723:x1876023288351744:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789115524.372483:0:5854:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789115524.372721:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1789115524.372782:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3dd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.372799:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.372811:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.372819:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3dd2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.372826:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3dd2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.372832:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3dd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115524.372921:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789115524.373042:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88a4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+22:11723:x1876023288351744:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 2227us (3045us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789115524.373052:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000020:00080000:3.0:1789115524.373065:0:5854:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789115524.373758:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115524.373767:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3dd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.373776:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb800 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115524.373780:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3dd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.373789:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3dd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.373802:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dfcf2157500) 00010000:00010000:0.0:1789115524.373805:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789115524.373810:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3dd2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.373816:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d3dd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115524.373833:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115524.373835:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115524.373836:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115524.772093:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc1164780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308272384:0@lo:400:kworker.0 00000100:00100000:3.0:1789115524.772163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115524.772234:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789115524.772241:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc1166580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308272512:0@lo:400:kworker.0 00000100:00100000:3.0:1789115524.772280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115524.772411:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc1166940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308272256:0@lo:400:kworker.0 00000100:00100000:1.0:1789115524.772440:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115524.772469:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789115524.772476:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc1165a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308272128:0@lo:400:kworker.0 00000100:00100000:1.0:1789115524.772503:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115524.772523:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc1167c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876023308272640:0@lo:400:kworker.0 00000100:00100000:1.0:1789115524.772555:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115524.772585:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308272384 00000100:00100000:1.0:1789115524.772592:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308272384 00000100:00100000:1.0:1789115524.772637:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308272256 00000100:00100000:1.0:1789115524.772641:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308272256 00000100:00100000:1.0:1789115524.772652:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308272640 00000100:00100000:1.0:1789115524.772655:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308272640 00000100:00100000:1.0:1789115524.772669:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789115524.772676:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc332940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308272384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115524.772723:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc332940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308272384:12345-0@lo:400:kworker.0 Request processed in 46us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115524.772730:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789115524.772744:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789115524.772751:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308272256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115524.772781:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308272256:12345-0@lo:400:kworker.0 Request processed in 31us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115524.772786:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789115524.772797:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789115524.772803:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876023308272640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115524.772827:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876023308272640:12345-0@lo:400:kworker.0 Request processed in 25us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115524.772845:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1789115524.772862:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115524.772889:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc1167c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876023308272640:0@lo:400:kworker.0 00000100:00100000:1.0:1789115524.772901:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc1166940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308272256:0@lo:400:kworker.0 00000100:00100000:3.0:1789115524.773049:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc1164780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308272384:0@lo:400:kworker.0 00000100:00100000:0.0:1789115524.773295:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308272512 00000100:00100000:0.0:1789115524.773301:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308272512 00000100:00100000:0.0:1789115524.773336:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789115524.773351:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc333c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308272512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115524.773446:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308272128 00000100:00100000:2.0:1789115524.773451:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308272128 00000100:00100000:2.0:1789115524.773488:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789115524.773495:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3308:x1876023308272128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115524.773552:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3308:x1876023308272128:12345-0@lo:400:kworker.0 Request processed in 57us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115524.773558:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789115524.773598:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc1165a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308272128:0@lo:400:kworker.0 00000100:00100000:0.0:1789115524.773912:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc333c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308272512:12345-0@lo:400:kworker.0 Request processed in 561us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115524.773919:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789115524.774008:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1789115524.774015:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1789115524.774033:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dfcfc09e580, transno 4294967307 00000100:00100000:3.0:1789115524.774092:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc1166580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308272512:0@lo:400:kworker.0 00010000:00010000:1.0:1789115524.837836:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115525.283922:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115525.284068:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308272768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115525.284762:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115525.285238:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308272768 00000100:00100000:1.0:1789115525.285246:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308272768 00000100:00100000:1.0:1789115525.285290:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789115525.285298:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876023308272768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789115525.285322:0:12414:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789115525.285368:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876023308272768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115525.285374:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789115525.285830:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308272768:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1789115525.841087:0:12951:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789115525.841095:0:12951:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789115525.841131:0:12951:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789115525.841139:0:12951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789115525.859497:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115525.992495:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115525.995484:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288352000 00000100:00100000:0.0:1789115525.995496:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288352000 00000100:00100000:0.0:1789115525.995574:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:0.0:1789115525.995586:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+22:11742:x1876023288352000:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115525.995610:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115525.995631:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3dd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3db7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115525.995885:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3de0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115525.995900:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3de0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115525.995912:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3de0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115525.995923:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1789115525.996108:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3dd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db7 expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115525.996125:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3de0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db7 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115525.996134:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115525.996142:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789115525.996146:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd021c5e00, rc 0) 00000100:00100000:0.0:1789115525.996221:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+24:11742:x1876023288352000:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 637us (3732us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789115525.996228:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 187 00000100:00080000:1.0:1789115525.996394:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115526.003328:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115526.003362:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288352128 00000100:00100000:2.0:1789115526.003370:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288352128 00000100:00100000:2.0:1789115526.003436:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:2.0:1789115526.003445:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+24:11742:x1876023288352128:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:2.0:1789115526.003519:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3dee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003536:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3dee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003548:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3dee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003562:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3df5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003576:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003582:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003841:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003850:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003858:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789115526.003891:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003902:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3dee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003909:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3dee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003916:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3dee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003922:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115526.003925:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3dee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003933:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3dee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003950:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:2.0:1789115526.003953:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115526.003958:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3dee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003965:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc400/0xa47abda6516d3dee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003975:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003981:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3df5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003987:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3df5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.003993:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115526.003996:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3df5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.004002:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3df5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.004009:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcc5118c00) 00010000:00010000:2.0:1789115526.004011:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115526.004013:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3df5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.004019:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d3df5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.004040:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.004060:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3dfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.004067:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.004072:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacca00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115526.004075:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.004081:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.004089:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcc5118700) 00010000:00010000:2.0:1789115526.004091:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115526.004094:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3dfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.004100:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d3dfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115526.004173:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+24:11742:x1876023288352128:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 728us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115526.004182:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:3.0:1789115526.045866:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.045942:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288352384 00000100:00100000:0.0:1789115526.045952:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288352384 00000100:00100000:0.0:1789115526.046006:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:0.0:1789115526.046017:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+24:11745:x1876023288352384:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115526.046037:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115526.046068:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3e03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3dbe expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.046149:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3e0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.046164:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3e0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.046175:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3e0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.046211:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.046220:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.046226:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.046823:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3200/0xa47abda6516d3e18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.046833:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3200/0xa47abda6516d3e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.046840:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3200/0xa47abda6516d3e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115526.046850:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789115526.046939:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3e0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.046946:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3e0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.046952:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3e0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.046957:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c5c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115526.046961:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3e0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.046968:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3e0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.046978:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115526.046980:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115526.046985:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3e0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.047001:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5c00/0xa47abda6516d3e0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.047014:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.047020:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.047025:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.047030:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115526.047033:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.047039:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.047058:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcd044fa00) 00010000:00010000:0.0:1789115526.047061:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115526.047064:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.047070:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.047361:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4400/0xa47abda6516d3e03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dbe expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.047376:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3200/0xa47abda6516d3e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dbe expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.047509:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:0.0:1789115526.047511:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115526.047514:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d3200, rc 0) 00000100:00100000:0.0:1789115526.047628:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+26:11745:x1876023288352384:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1612us (1768us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789115526.047636:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:2.0:1789115526.051183:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.051310:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288352512 00000100:00100000:0.0:1789115526.051319:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288352512 00000100:00100000:0.0:1789115526.051379:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:0.0:1789115526.051426:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc11661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+26:11745:x1876023288352512:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:0.0:1789115526.051491:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d3e26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.051508:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d3e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.051520:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d3e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.051545:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d3e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.051552:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d3e26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.051565:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d3e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.051571:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115526.051590:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d3e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.051597:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d3e26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.051609:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:0.0:1789115526.051612:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789115526.051616:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d3e26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.051622:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d3e26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115526.051696:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc11661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+26:11745:x1876023288352512:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 272us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115526.051704:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:3.0:1789115526.055654:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.055774:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288352768 00000100:00100000:0.0:1789115526.055784:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288352768 00000100:00100000:0.0:1789115526.055878:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:0.0:1789115526.055889:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+26:11745:x1876023288352768:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1789115526.056162:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+27:11745:x1876023288352768:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 274us (514us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1789115526.056170:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:3.0:1789115526.095362:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.095535:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288353024 00000100:00100000:0.0:1789115526.095545:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288353024 00000100:00100000:0.0:1789115526.095594:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:0.0:1789115526.095603:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+27:11270:x1876023288353024:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1789115526.095625:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115526.095822:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d3e2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3dc5 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.096034:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.096060:0:8213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3200/0xa47abda6516d3e18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dbe expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.096069:0:8213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.096332:0:8213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3200/0xa47abda6516d3e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dbe expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.096346:0:8213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3200/0xa47abda6516d3e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dbe expref: 28 pid: 5852 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115526.096360:0:8213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308272896:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115526.096694:0:8213:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd84279c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115526.098772:0:8213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308272896:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115526.098798:0:8213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115526.106602:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115526.108578:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288353152 00000100:00100000:2.0:1789115526.108592:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288353152 00010000:00010000:2.0:1789115526.108652:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3200/0xa47abda6516d3e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dbe expref: 29 pid: 5852 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115526.108688:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:2.0:1789115526.108698:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+29:2353:x1876023288353152:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115526.108712:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115526.108719:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3200/0xa47abda6516d3e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dbe expref: 29 pid: 5852 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.108845:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3200/0xa47abda6516d3e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dbe expref: 29 pid: 5852 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.108868:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3200/0xa47abda6516d3e18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dbe expref: 29 pid: 5852 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.108885:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:2.0:1789115526.108890:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.108898:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.108905:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.109960:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115526.110033:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+28:2353:x1876023288353152:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1332us (3435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115526.110043:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00010000:00010000:3.0:1789115526.111235:0:8213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.111247:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115526.111265:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789115526.111405:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d3e2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dc5 expref: 29 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.111419:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dc5 expref: 28 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.111425:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:3.0:1789115526.111427:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789115526.111429:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d2a00, rc 0) 00000100:00100000:3.0:1789115526.111475:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+28:11270:x1876023288353024:12345-192.168.203.31@tcp:101:bash.0 Request processed in 15874us (16123us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789115526.111481:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:3.0:1789115526.113968:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.114103:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288353408 00000100:00100000:0.0:1789115526.114181:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288353408 00000100:00100000:0.0:1789115526.114311:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:0.0:1789115526.114324:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+28:11270:x1876023288353408:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:1.0:1789115526.115093:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.115111:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.115123:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789115526.115175:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1789115526.115201:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005fd23ab0 reply state 00000000e01416cc transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115526.115209:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789115526.115268:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1789115526.115786:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+32:11270:x1876023288353408:12345-192.168.203.31@tcp:36:bash.0 Request processed in 1460us (1822us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1789115526.115795:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 192 00000020:00080000:1.0:1789115526.115801:0:5851:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789115526.119236:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.119253:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.119269:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.119275:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115526.119280:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.119287:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.119307:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:1.0:1789115526.119310:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115526.119315:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.119426:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115526.120762:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.120867:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288353536 00000100:00100000:1.0:1789115526.120876:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288353536 00000100:00100000:1.0:1789115526.120927:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:1.0:1789115526.120937:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+31:11270:x1876023288353536:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1789115526.120973:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115526.120991:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3e49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3dcc expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.121071:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3e49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dcc expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.121085:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3e49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dcc expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.121103:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:1.0:1789115526.121106:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789115526.121110:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6a00, rc 0) 00000100:00100000:1.0:1789115526.121170:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+32:11270:x1876023288353536:12345-192.168.203.31@tcp:101:bash.0 Request processed in 235us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115526.121177:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:2.0:1789115526.124147:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115526.124245:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288353664 00000100:00100000:3.0:1789115526.124254:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288353664 00000100:00100000:3.0:1789115526.124332:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:3.0:1789115526.124343:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:11270:x1876023288353664:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1789115526.124361:0:6885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115526.124429:0:6885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e104f16/0xa47abda6516d3e50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3dd3 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789115526.124453:0:6885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3bc82, atime: 0x6aa3bc80, ctime: 0x6aa3bc82, blocks: 0xb 00010000:00010000:3.0:1789115526.124472:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1789115526.124477:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115526.124496:0:6885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e104f16/0xa47abda6516d3e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dd3 expref: 8 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.124512:0:6885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e104f16/0xa47abda6516d3e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dd3 expref: 8 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.124524:0:6885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb600, rc 0) 00000100:00100000:3.0:1789115526.124581:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+8:11270:x1876023288353664:12345-192.168.203.31@tcp:101:bash.0 Request processed in 241us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115526.124587:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00080000:1.0:1789115526.124668:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789115526.133627:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115526.133754:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288353792 00000100:00100000:3.0:1789115526.133766:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288353792 00002000:00010000:3.0:1789115526.133814:0:6704:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789115526.133819:0:6704:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfbc1167840 with x1876023288353792 ext(0->18446744073709551615) 00002000:00010000:3.0:1789115526.133832:0:6704:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfbc1167840. 00000100:00100000:3.0:1789115526.133865:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1789115526.133873:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1167840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:2352:x1876023288353792:12345-192.168.203.31@tcp:10:bash.0 00002000:00010000:3.0:1789115526.134131:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789115526.134134:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789115522 -> 1789115525 00002000:00010000:3.0:1789115526.134137:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789115520 -> 1789115520 00002000:00010000:3.0:1789115526.134150:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789115522 -> 1789115525 00002000:00010000:3.0:1789115526.134156:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789115526.134221:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1167840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6dbf7574-92fb-4b89-af78-41319f924699+9:2352:x1876023288353792:12345-192.168.203.31@tcp:10:bash.0 Request processed in 349us (602us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789115526.134228:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00002000:00010000:3.0:1789115526.134231:0:6704:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789115526.134233:0:6704:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfbc1167840 with x1876023288353792 ext(0->18446744073709551615) 00002000:00010000:3.0:1789115526.134238:0:6704:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfbc1167840. 00000100:00100000:2.0:1789115526.229327:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.229500:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288353920 00000100:00100000:0.0:1789115526.229522:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288353920 00000100:00100000:0.0:1789115526.229990:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:0.0:1789115526.230003:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc11652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+32:11759:x1876023288353920:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:0.0:1789115526.230087:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3e57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230104:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3e57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230129:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3e57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230269:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230279:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230288:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230699:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3e65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230708:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230715:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789115526.230915:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230938:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3e57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230944:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3e57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230952:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3e57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230958:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115526.230961:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3e57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230969:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3e57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230980:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115526.230983:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115526.230988:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3e57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.230994:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3e57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.231005:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.231011:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3e5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.231017:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.231028:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115526.231031:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.231037:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3e5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.231056:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcd044fa00) 00010000:00010000:0.0:1789115526.231059:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115526.231061:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3e5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.231067:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3e5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.231081:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.231087:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3e65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.231093:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3e65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.231099:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115526.231101:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3e65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.231107:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3e65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.231136:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:0.0:1789115526.231138:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115526.231142:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3e65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.231284:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3e65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115526.231589:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc11652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+32:11759:x1876023288353920:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 1578us (2260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115526.231599:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:0.0:1789115526.262204:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.262412:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288354176 00000100:00100000:1.0:1789115526.262421:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288354176 00000100:00100000:1.0:1789115526.262478:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:1.0:1789115526.262489:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+32:11762:x1876023288354176:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115526.262521:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115526.262543:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3dda expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.262613:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.262643:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.262654:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.262669:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.262676:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.262682:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.262998:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3e81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263007:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263014:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115526.263023:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789115526.263224:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263232:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263238:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263250:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115526.263254:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263261:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263272:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115526.263275:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115526.263279:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263285:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263465:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263473:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3e7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263479:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263485:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115526.263488:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263495:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3e7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263512:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115526.263515:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115526.263518:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3e7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263524:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263568:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dda expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263583:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dda expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.263590:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:1.0:1789115526.263592:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789115526.263594:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6c00, rc 0) 00000100:00100000:1.0:1789115526.263663:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+34:11762:x1876023288354176:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1176us (1467us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789115526.263670:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:2.0:1789115526.269700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.269904:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288354304 00000100:00100000:1.0:1789115526.269913:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288354304 00000100:00100000:1.0:1789115526.270001:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:1.0:1789115526.270011:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1164b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+34:11762:x1876023288354304:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1789115526.270092:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.270109:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dc5 expref: 34 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.270131:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.270164:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dc5 expref: 34 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.270177:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dc5 expref: 34 pid: 8213 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115526.270190:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308273024:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115526.270283:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcedacf180 going to sleep for 11 seconds 00000100:00100000:2.0:1789115526.275077:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.275255:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308273024:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115526.275258:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288354560 00000100:00100000:3.0:1789115526.275264:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288354560 00010000:00010000:1.0:1789115526.275279:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115526.275505:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:3.0:1789115526.275515:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1165a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+35:9234:x1876023288354560:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789115526.275822:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1165a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+36:9234:x1876023288354560:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 306us (752us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789115526.275830:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:2.0:1789115526.280960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.281024:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288354688 00000100:00100000:1.0:1789115526.281033:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288354688 00010000:00010000:1.0:1789115526.281082:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dc5 expref: 36 pid: 8213 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115526.281125:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:1.0:1789115526.281135:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1165680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+36:2353:x1876023288354688:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115526.281148:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115526.281155:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dc5 expref: 36 pid: 8213 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.281184:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dc5 expref: 36 pid: 8213 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.281205:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d3e34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dc5 expref: 36 pid: 8213 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.281222:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:1.0:1789115526.281227:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.281236:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.281244:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.281285:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115526.281417:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1165680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+35:2353:x1876023288354688:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 250us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115526.281425:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00010000:00010000:3.0:1789115526.281634:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.281642:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.281670:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.281677:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.281684:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.281697:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115526.281702:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.281709:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.281718:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:3.0:1789115526.281721:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789115526.281725:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.281730:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3e8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115526.281771:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1164b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+34:11762:x1876023288354304:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 11761us (12089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115526.281779:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:2.0:1789115526.286728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.287654:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288354944 00000100:00100000:0.0:1789115526.287664:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288354944 00000100:00100000:3.0:1789115526.287962:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1789115526.287975:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1166580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+34:11762:x1876023288354944:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1789115526.288216:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1166580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+35:11762:x1876023288354944:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 244us (1497us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789115526.288224:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:2.0:1789115526.353787:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.353890:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288355200 00000100:00100000:1.0:1789115526.353899:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288355200 00000100:00100000:1.0:1789115526.353954:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:1.0:1789115526.353965:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1164780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+35:11773:x1876023288355200:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:1.0:1789115526.353989:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115526.354007:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3e96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3de1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354109:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354124:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354135:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354149:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ea4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354156:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354163:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354575:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3eab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354584:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354592:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115526.354602:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789115526.354684:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354692:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354703:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354709:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115526.354713:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354721:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354733:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115526.354736:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115526.354741:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354747:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d3e9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354760:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354767:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ea4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354772:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354778:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115526.354781:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354797:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354805:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115526.354808:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115526.354811:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ea4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354816:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3ea4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354857:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3e96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3de1 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354872:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3eab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3de1 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.354879:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:1.0:1789115526.354881:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115526.354883:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7200, rc 0) 00000100:00100000:1.0:1789115526.355056:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1164780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+37:11773:x1876023288355200:12345-192.168.203.31@tcp:101:cat.0 Request processed in 1092us (1277us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789115526.355064:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:2.0:1789115526.367697:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115526.367776:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288355456 00000100:00100000:3.0:1789115526.367785:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288355456 00000100:00100000:3.0:1789115526.367846:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:3.0:1789115526.367857:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1166940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+37:11773:x1876023288355456:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:3.0:1789115526.368113:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1166940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+38:11773:x1876023288355456:12345-192.168.203.31@tcp:35:cat.0 Request processed in 257us (424us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789115526.368121:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1789115526.404376:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.404843:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288355712 00000100:00100000:0.0:1789115526.404853:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288355712 00000100:00100000:0.0:1789115526.404911:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:0.0:1789115526.404921:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1167c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+38:11774:x1876023288355712:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:0.0:1789115526.404971:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789115526.404995:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3eab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3de1 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.405017:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3e81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dda expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.405031:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3e49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dcc expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.405073:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:0.0:1789115526.405084:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115526.405104:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3eb9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.405118:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3eb9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.405127:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3eb9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.405141:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3ec0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.405149:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.405155:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.405475:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ec7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.405484:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.405492:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789115526.406042:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1789115526.406064:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343618681036ns, next at 344618678383ns, rc = 0 00010000:00010000:0.0:1789115526.406129:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d3ece lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406138:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d3ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406145:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d3ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406152:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d3ece lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406158:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d3ece lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406163:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d3ece lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406178:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789115526.406195:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406200:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ec7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406206:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ec7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406212:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115526.406216:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ec7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406223:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ec7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406240:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044fe00) 00010000:00010000:0.0:1789115526.406243:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789115526.406247:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ec7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406253:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ec7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406267:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3eb9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406273:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3eb9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406279:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3eb9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406284:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115526.406287:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3eb9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406293:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3eb9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406301:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115526.406304:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115526.406307:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3eb9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.406313:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3eb9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789115526.406333:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a5a9c0f7 reply state 000000003cfdecf5 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115526.406342:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789115526.406453:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1167c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+37:11774:x1876023288355712:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1530us (2082us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789115526.406461:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 198 00010000:00010000:1.0:1789115526.406536:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115526.406544:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d3ece lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.406550:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2c00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115526.406559:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d3ece lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.406566:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d3ece lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.406574:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dfcd044fe00) 00010000:00010000:1.0:1789115526.406577:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789115526.406580:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d3ece lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.406586:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d3ece lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.406598:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115526.406599:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115526.406601:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115526.415695:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.415711:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3ec0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.415718:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3ec0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.415724:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115526.415728:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3ec0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.415735:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3ec0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.415753:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcd044fa00) 00010000:00010000:0.0:1789115526.415756:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115526.415761:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3ec0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.415766:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3ec0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115526.457493:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.457584:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288355968 00000100:00100000:0.0:1789115526.457593:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288355968 00000100:00100000:0.0:1789115526.457653:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:0.0:1789115526.457663:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc11670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+36:11780:x1876023288355968:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1789115526.457686:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115526.457706:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3ed5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3de8 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.457829:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3edc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.457843:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3edc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.457853:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3edc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.457866:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ee3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.457872:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.457877:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789115526.458419:0:8213:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789115526.458574:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3eea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.458595:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.458605:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.458639:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3edc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.458647:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3edc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.458653:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3edc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.458660:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115526.458665:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3edc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.458673:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3edc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.458685:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115526.458688:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115526.458693:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3edc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.458700:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3edc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789115526.458713:0:8213:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000024dbf0eb reply state 000000002e5c7a77 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115526.458727:0:8213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789115526.458754:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3ed5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3de8 expref: 39 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.458768:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3de8 expref: 38 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.458775:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:0.0:1789115526.458777:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115526.458780:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d2e00, rc 0) 00000100:00100000:0.0:1789115526.458836:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc11670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+39:11780:x1876023288355968:12345-192.168.203.31@tcp:101:bash.0 Request processed in 1175us (1350us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789115526.458844:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:2.0:1789115526.462823:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:1.0:1789115526.462918:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.462929:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ee3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.462935:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.462941:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115526.462946:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.462953:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ee3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.462979:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcd044fa00) 00010000:00010000:1.0:1789115526.462981:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115526.462986:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ee3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.462992:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d3ee3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115526.463075:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288356096 00000100:00100000:0.0:1789115526.463084:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288356096 00000100:00100000:0.0:1789115526.463149:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:0.0:1789115526.463158:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2352:x1876023288356096:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1789115526.463175:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115526.463190:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b922439/0xa47abda6516d3ef8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3def expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789115526.463212:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115526.463232:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1789115526.463237:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115526.463245:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b922439/0xa47abda6516d3ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3def expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.463274:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b922439/0xa47abda6516d3ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3def expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.463285:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d2000, rc 0) 00000100:00100000:0.0:1789115526.463342:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288356096:12345-192.168.203.31@tcp:101:bash.0 Request processed in 184us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115526.463349:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00080000:1.0:1789115526.463543:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789115526.470866:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115526.470964:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288356224 00000100:00100000:3.0:1789115526.470974:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288356224 00000100:00100000:3.0:1789115526.471029:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:3.0:1789115526.471039:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedb3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+6:11780:x1876023288356224:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1789115526.471069:0:6885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115526.471086:0:6885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3df6 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.471113:0:6885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b922439/0xa47abda6516d3ef8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3def expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.471122:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115526.471126:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115526.471131:0:6885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 7 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.471161:0:6885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b922439/0xa47abda6516d3ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3def expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115526.471174:0:6885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b922439/0xa47abda6516d3ef8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3def expref: 7 pid: 6699 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115526.471187:0:6885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc12afc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6885:1876023308273152:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115526.471284:0:6885:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd965e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789115526.473859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.473940:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288356352 00000100:00100000:0.0:1789115526.473948:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288356352 00010000:00010000:0.0:1789115526.473984:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b922439/0xa47abda6516d3ef8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3def expref: 8 pid: 6699 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115526.474026:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:0.0:1789115526.474036:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12ad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+8:2352:x1876023288356352:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115526.474065:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115526.474098:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b922439/0xa47abda6516d3ef8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3def expref: 8 pid: 6699 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.474111:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b922439/0xa47abda6516d3ef8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3def expref: 8 pid: 6699 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.474136:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115526.474140:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115526.474148:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 8 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.474169:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 8 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.474204:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 8 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115526.474218:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603cf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5835:1876023308273280:192.168.203.31@tcp:105: 00000100:00100000:0.0:1789115526.474290:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd84270c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789115526.474759:0:6885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b922439/0xa47abda6516d3ef8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3def expref: 8 pid: 6699 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115526.474775:0:6885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc12afc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6885:1876023308273152:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789115526.474797:0:6885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 7 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.474807:0:6885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ea000, rc 0) 00000100:00100000:2.0:1789115526.474846:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedb3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:11780:x1876023288356224:12345-192.168.203.31@tcp:101:bash.0 Request processed in 3808us (3989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115526.474854:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:0.0:1789115526.479156:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603cf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5835:1876023308273280:192.168.203.31@tcp:105: 00010000:00010000:0.0:1789115526.479187:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115526.479242:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12ad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288356352:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 5206us (5390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115526.479252:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:0.0:1789115526.481432:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.481516:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288356608 00000100:00100000:1.0:1789115526.481525:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288356608 00000100:00100000:1.0:1789115526.481588:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:1.0:1789115526.481598:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+38:11780:x1876023288356608:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:1.0:1789115526.481916:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+39:11780:x1876023288356608:12345-192.168.203.31@tcp:35:bash.0 Request processed in 320us (492us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789115526.481924:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:3.0:1789115526.619299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.619422:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288356736 00000100:00100000:1.0:1789115526.619431:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288356736 00000100:00100000:1.0:1789115526.619476:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:1.0:1789115526.619483:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+39:11796:x1876023288356736:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115526.623226:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115526.623255:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3dfd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.623320:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3f0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.623360:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.623371:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115526.623441:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1789115526.623445:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115526.623466:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.623492:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dfd expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.623512:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3f0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dfd expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.623521:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115526.623523:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789115526.623527:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7400, rc 0) 00000100:00100000:1.0:1789115526.623595:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+40:11796:x1876023288356736:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 4110us (4304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115526.623604:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:2.0:1789115526.633187:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.633245:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288356992 00000100:00100000:0.0:1789115526.633255:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288356992 00000100:00100000:0.0:1789115526.633315:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:0.0:1789115526.633325:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+40:11796:x1876023288356992:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115526.633345:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115526.633364:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3f14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e04 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.633510:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3f1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.633544:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.633556:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115526.633568:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789115526.633688:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3f14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e04 expref: 43 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.633706:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e04 expref: 42 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.633713:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:0.0:1789115526.633716:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115526.633720:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d3a00, rc 0) 00000100:00100000:0.0:1789115526.633777:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+42:11796:x1876023288356992:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 454us (600us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789115526.633792:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:2.0:1789115526.639011:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.639219:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288357248 00000100:00100000:0.0:1789115526.639228:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288357248 00000100:00100000:0.0:1789115526.639286:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 202 00000100:00100000:0.0:1789115526.639297:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+42:11796:x1876023288357248:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115526.639319:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115526.639339:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3000/0xa47abda6516d3f29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e0b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.639485:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3f30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.639500:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3f30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.639512:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3f30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115526.639676:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789115526.640478:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3000/0xa47abda6516d3f29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e0b expref: 45 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.640498:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3f30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e0b expref: 44 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.640507:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:0.0:1789115526.640510:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789115526.640513:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d3e00, rc 0) 00000100:00100000:0.0:1789115526.644229:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+44:11796:x1876023288357248:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 4719us (5013us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789115526.644246:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 202 00000100:00100000:2.0:1789115526.647739:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.649914:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288357376 00000100:00100000:1.0:1789115526.649928:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288357376 00000100:00100000:1.0:1789115526.649993:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:1.0:1789115526.650003:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+44:2351:x1876023288357376:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115526.650019:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115526.650064:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3a00/0xa47abda6516d3f1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e04 expref: 44 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.650083:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:1.0:1789115526.650089:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115526.650164:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+43:2351:x1876023288357376:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 162us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115526.650171:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:3.0:1789115526.657157:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.658418:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288357504 00000100:00100000:0.0:1789115526.658431:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288357504 00000100:00100000:0.0:1789115526.658495:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1789115526.658504:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+6:2352:x1876023288357504:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:0.0:1789115526.658546:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acc9828c/0xa47abda6516d3f3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.658576:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 6 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.658584:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115526.658588:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789115526.658593:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acc9828c/0xa47abda6516d3f3e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.658627:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 6 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.658642:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 6 pid: 6885 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115526.658656:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6699:1876023308273408:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115526.658755:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd84270c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115526.661576:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6699:1876023308273408:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789115526.661613:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acc9828c/0xa47abda6516d3f3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115526.661847:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.661974:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288357632 00000100:00100000:1.0:1789115526.661981:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288357632 00002000:00100000:1.0:1789115526.662029:0:6703:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8dfcc12af480 x1876023288357632/t0(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:342/0 lens 504/0 e 0 to 0 dl 1789115537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789115526.662039:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcc12af480 with x1876023288357632 ext(0->8) 00010000:00010000:1.0:1789115526.662058:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 7 pid: 6885 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.662071:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 7 pid: 6885 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789115526.662079:0:6703:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dfcc12af480 00000100:00100000:1.0:1789115526.662108:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:1.0:1789115526.662126:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288357632:12345-192.168.203.31@tcp:4:lfs.0 00000100:00100000:1.0:1789115526.662989:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6dbf7574-92fb-4b89-af78-41319f924699+9:2353:x1876023288357632:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 869us (1139us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789115526.662998:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00002000:00100000:1.0:1789115526.663006:0:6703:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8dfcc12af480 x1876023288357632/t4294967308(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:342/0 lens 504/448 e 0 to 0 dl 1789115537 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789115526.663020:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcc12af480 with x1876023288357632 ext(0->8) 00010000:00010000:1.0:1789115526.663027:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 9 pid: 6885 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.663051:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 9 pid: 6885 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789115526.663059:0:6703:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dfcc12af480 00000100:00100000:0.0:1789115526.667492:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.667746:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288357760 00000100:00100000:1.0:1789115526.667754:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288357760 00010000:00010000:1.0:1789115526.667848:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 9 pid: 6885 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115526.667918:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:1.0:1789115526.667927:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+9:2352:x1876023288357760:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115526.667941:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789115526.667957:0:6713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789115526.667960:0:6713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789115525 00002000:00010000:1.0:1789115526.667963:0:6713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789115525 00002000:00010000:1.0:1789115526.667965:0:6713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789115525 00010000:00010000:1.0:1789115526.667970:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 9 pid: 6885 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.667984:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 9 pid: 6885 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.668023:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e769d322/0xa47abda6516d3eff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3df6 expref: 9 pid: 6885 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.668040:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789115526.668055:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789115526.668060:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acc9828c/0xa47abda6516d3f3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.668071:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acc9828c/0xa47abda6516d3f3e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.668102:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115526.668162:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+8:2352:x1876023288357760:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 236us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115526.668169:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00010000:00010000:2.0:1789115526.668225:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acc9828c/0xa47abda6516d3f3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.668235:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acc9828c/0xa47abda6516d3f3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.668257:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acc9828c/0xa47abda6516d3f3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.668265:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acc9828c/0xa47abda6516d3f3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.668274:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acc9828c/0xa47abda6516d3f3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.668280:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:2.0:1789115526.668284:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acc9828c/0xa47abda6516d3f3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.668293:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acc9828c/0xa47abda6516d3f3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.668315:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acc9828c/0xa47abda6516d3f3e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.668323:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acc9828c/0xa47abda6516d3f3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115526.668376:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2352:x1876023288357504:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 9873us (11227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115526.668420:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:2.0:1789115526.672959:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.673056:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288358016 00000100:00100000:1.0:1789115526.673065:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288358016 00000100:00100000:1.0:1789115526.673118:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:1.0:1789115526.673128:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+43:11796:x1876023288358016:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:1.0:1789115526.673188:0:5854:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3f30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e0b expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789115526.673737:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1789115526.673847:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1789115526.674158:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1789115526.674212:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.674235:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3eea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3de8 expref: 47 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.674244:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.674278:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3de8 expref: 47 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.674294:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3eea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3de8 expref: 47 pid: 8213 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115526.674310:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5854:1876023308273536:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115526.674947:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcedacfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789115526.690966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115526.691076:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288358144 00000100:00100000:2.0:1789115526.691094:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288358144 00010000:00010000:2.0:1789115526.691135:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3eea lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3de8 expref: 48 pid: 8213 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115526.691185:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:2.0:1789115526.691194:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12af840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+48:2353:x1876023288358144:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115526.691209:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115526.691216:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3eea lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3de8 expref: 48 pid: 8213 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.691229:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3eea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3de8 expref: 48 pid: 8213 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.691251:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:2.0:1789115526.691269:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.691277:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.691285:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.691303:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115526.691358:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12af840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+48:2353:x1876023288358144:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 165us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115526.691366:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00010000:00010000:1.0:1789115526.692705:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3eea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3de8 expref: 47 pid: 8213 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115526.692726:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5854:1876023308273536:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115526.692745:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.692754:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.692760:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789115526.692878:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789115526.693706:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1789115526.693825:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876023308273664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789115526.693880:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115526.693915:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789115526.694219:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308273664 00000100:00100000:3.0:1789115526.694226:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308273664 00000100:00100000:3.0:1789115526.694326:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789115526.694336:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1876023308273664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789115526.694440:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1876023308273664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 105us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115526.694447:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789115526.694591:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876023308273664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789115526.695038:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1789115526.695113:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876023308273792:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789115526.695148:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115526.695270:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcedacfb40 going to sleep for 11 seconds 00000100:00080000:1.0:1789115526.696162:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789115526.696352:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308273792 00000100:00100000:2.0:1789115526.696361:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308273792 00000100:00100000:2.0:1789115526.696415:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789115526.696424:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1876023308273792:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789115526.696790:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5854:x1876023308273792:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 367us (1640us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789115526.696798:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789115526.696894:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876023308273792:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789115526.696960:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1789115526.697017:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.697159:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.697277:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.697285:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115526.697289:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.697298:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.697313:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:0.0:1789115526.697316:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789115526.697321:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.697327:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6000/0xa47abda6516d3f45 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789115526.697799:0:5854:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789115526.697884:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1789115526.697894:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343910511754ns, next at 344910509629ns, rc = 0 00000001:00080000:0.0:1789115526.697901:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1789115526.697936:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044fc00) 00010000:00010000:0.0:1789115526.697940:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789115526.697947:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3f30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e0b expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115526.698316:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+50:11796:x1876023288358016:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 25188us (25365us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1789115526.698326:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000020:00080000:0.0:1789115526.698331:0:5854:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789115526.702742:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.702972:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288358272 00000100:00100000:0.0:1789115526.702982:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288358272 00000100:00100000:0.0:1789115526.703038:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:0.0:1789115526.703058:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+50:11796:x1876023288358272:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115526.703080:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115526.703101:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2400/0xa47abda6516d3f4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e12 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.703160:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2400/0xa47abda6516d3f4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e12 expref: 51 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.703175:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2400/0xa47abda6516d3f4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e12 expref: 51 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.703204:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:0.0:1789115526.703208:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789115526.703212:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d2400, rc 0) 00000100:00100000:0.0:1789115526.703278:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+51:11796:x1876023288358272:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 222us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115526.703286:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:1.0:1789115526.708793:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115526.708888:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288358528 00000100:00100000:3.0:1789115526.708898:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288358528 00000100:00100000:3.0:1789115526.709003:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:3.0:1789115526.709014:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+51:11796:x1876023288358528:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1789115526.709581:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+52:11796:x1876023288358528:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 567us (791us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1789115526.709590:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1789115526.792012:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.792131:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288358656 00000100:00100000:1.0:1789115526.792141:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288358656 00000100:00100000:1.0:1789115526.792198:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:1.0:1789115526.792208:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5739680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+52:11806:x1876023288358656:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:1.0:1789115526.792280:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792297:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792311:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792326:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792334:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792341:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792472:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3f61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792481:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792502:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789115526.792540:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792552:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792558:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f53 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792565:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792572:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115526.792576:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792583:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f53 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792595:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115526.792598:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115526.792602:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792608:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792622:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792635:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792641:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792646:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115526.792649:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792655:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792662:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115526.792665:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115526.792667:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792672:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792685:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792691:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3f61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792696:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792700:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115526.792707:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792714:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3f61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792721:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:1.0:1789115526.792724:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115526.792726:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3f61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.792731:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3f61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115526.792796:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5739680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+52:11806:x1876023288358656:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 588us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115526.792804:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:2.0:1789115526.834103:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.834659:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288358912 00000100:00100000:1.0:1789115526.834670:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288358912 00000100:00100000:1.0:1789115526.834823:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:1.0:1789115526.834833:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+52:11809:x1876023288358912:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115526.834852:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115526.834873:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3f68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e19 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.834942:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.834957:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.834986:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835000:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835008:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835015:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835157:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3f7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835166:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835173:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115526.835182:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789115526.835414:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835423:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835429:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835434:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115526.835444:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835452:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835464:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115526.835467:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115526.835471:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835478:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d3f6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835490:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835496:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835502:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835507:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115526.835510:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835516:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835612:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115526.835615:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115526.835623:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835630:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3f76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835665:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3f68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e19 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835676:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3f7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e19 expref: 54 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.835683:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:1.0:1789115526.835685:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115526.835688:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7000, rc 0) 00000100:00100000:1.0:1789115526.835837:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+54:11809:x1876023288358912:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1005us (1741us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1789115526.835845:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:2.0:1789115526.838608:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.838697:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288359040 00000100:00100000:1.0:1789115526.838706:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288359040 00000100:00100000:1.0:1789115526.838759:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:1.0:1789115526.838769:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+54:11809:x1876023288359040:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1789115526.838829:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3f8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.838844:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.838854:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.838892:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.838898:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3f8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.838904:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3f8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.838911:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115526.838915:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3f8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.838921:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3f8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.838933:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:1.0:1789115526.838936:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789115526.838940:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3f8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.838946:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3f8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115526.839019:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+54:11809:x1876023288359040:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 253us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115526.839026:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:2.0:1789115526.840447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.840764:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288359296 00000100:00100000:0.0:1789115526.840773:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288359296 00000100:00100000:0.0:1789115526.840831:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:0.0:1789115526.840841:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+54:11809:x1876023288359296:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1789115526.841034:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+55:11809:x1876023288359296:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 195us (594us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789115526.841053:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00010000:00010000:2.0:1789115526.883728:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115526.902624:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.902710:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288359552 00000100:00100000:0.0:1789115526.902720:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288359552 00000100:00100000:0.0:1789115526.902782:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 207 00000100:00100000:0.0:1789115526.902793:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+55:11819:x1876023288359552:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1789115526.902816:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115526.902819:0:8213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789115526.902846:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d3f0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dfd expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.902865:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115526.902870:0:8213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115526.902883:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3f92 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e20 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.902970:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.902984:0:8213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3f7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e19 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.902992:0:8213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.903353:0:8213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3f7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e19 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.903366:0:8213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3f7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e19 expref: 55 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115526.903379:0:8213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308273920:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115526.905712:0:8213:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc12ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1789115526.909818:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.909919:0:8213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8213:1876023308273920:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115526.909946:0:8213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115526.910120:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288359680 00000100:00100000:2.0:1789115526.910127:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288359680 00010000:00010000:2.0:1789115526.910164:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3f7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e19 expref: 56 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115526.910218:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:2.0:1789115526.910228:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+56:2353:x1876023288359680:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115526.910243:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115526.910250:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3f7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e19 expref: 56 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.910261:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3f7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e19 expref: 56 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.910283:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d3f7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e19 expref: 56 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.910297:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:2.0:1789115526.910302:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.910310:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.910317:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115526.910342:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115526.910520:0:8213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.910528:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115526.910545:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789115526.910685:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3f92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e20 expref: 57 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.910700:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e20 expref: 56 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.910708:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:0.0:1789115526.910710:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789115526.910720:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d2200, rc 0) 00000100:00100000:0.0:1789115526.910745:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+56:11819:x1876023288359552:12345-192.168.203.31@tcp:101:bash.0 Request processed in 7955us (8130us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789115526.910754:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 207 00000100:00100000:2.0:1789115526.910912:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+55:2353:x1876023288359680:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 685us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115526.910921:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:2.0:1789115526.913693:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.913787:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288359936 00000100:00100000:1.0:1789115526.913796:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288359936 00000100:00100000:1.0:1789115526.913848:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 208 00000100:00100000:1.0:1789115526.913863:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc57392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+55:11819:x1876023288359936:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:1.0:1789115526.915720:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3fa7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.915740:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.915752:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789115526.915817:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1789115526.915842:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cd4c4dc1 reply state 00000000cee4dd9e transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115526.915852:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789115526.915956:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc57392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+58:11819:x1876023288359936:12345-192.168.203.31@tcp:36:bash.0 Request processed in 2092us (2268us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789115526.915965:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 208 00000020:00080000:1.0:1789115526.915969:0:5851:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789115526.920584:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.920617:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3fa7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.920628:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.920635:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115526.920641:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.920650:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3fa7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.920672:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:0.0:1789115526.920676:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115526.920683:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3fa7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.920689:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d3fa7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115526.923176:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115526.923438:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288360064 00000100:00100000:1.0:1789115526.923450:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288360064 00000100:00100000:1.0:1789115526.923536:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:1.0:1789115526.923549:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+57:11819:x1876023288360064:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1789115526.923583:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115526.923619:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3fae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e27 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.923739:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.923780:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e20 expref: 58 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.923790:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.923834:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e20 expref: 58 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.923850:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e20 expref: 58 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115526.923867:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcedabd680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876023308274048:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115526.924151:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd136ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789115526.927353:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115526.927513:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288360192 00000100:00100000:0.0:1789115526.927534:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288360192 00010000:00010000:0.0:1789115526.927588:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e20 expref: 59 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115526.927912:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:0.0:1789115526.927924:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12aed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+59:2352:x1876023288360192:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115526.927944:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115526.927953:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e20 expref: 59 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.928136:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e20 expref: 59 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.928168:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:0.0:1789115526.928174:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.928185:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.928194:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115526.928218:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115526.928324:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12aed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+59:2352:x1876023288360192:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 402us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115526.928333:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00010000:00010000:1.0:1789115526.928457:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3f99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e20 expref: 58 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115526.928477:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcedabd680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876023308274048:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115526.928511:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.928526:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.928532:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115526.928584:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789115526.928612:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115526.928640:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.928677:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d3fae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e27 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.928693:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e27 expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115526.928701:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:1.0:1789115526.928704:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115526.928706:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6a00, rc 0) 00000100:00100000:1.0:1789115526.928735:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+57:11819:x1876023288360064:12345-192.168.203.31@tcp:101:bash.0 Request processed in 5190us (5573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115526.928743:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:3.0:1789115526.940930:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115526.943279:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288360448 00000100:00100000:2.0:1789115526.943300:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288360448 00000100:00100000:2.0:1789115526.943403:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:2.0:1789115526.943415:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+57:11819:x1876023288360448:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:2.0:1789115526.944048:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+58:11819:x1876023288360448:12345-192.168.203.31@tcp:35:bash.0 Request processed in 623us (3120us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789115526.944059:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:3.0:1789115527.004717:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.004889:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288360576 00000100:00100000:0.0:1789115527.004902:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288360576 00000100:00100000:0.0:1789115527.004999:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:0.0:1789115527.005012:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+58:11825:x1876023288360576:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115527.005072:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115527.005101:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3fbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e2e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.005183:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3400/0xa47abda6516d3fc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.005200:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3400/0xa47abda6516d3fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.005213:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3400/0xa47abda6516d3fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115527.005292:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1789115527.005297:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115527.005325:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3400/0xa47abda6516d3fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.005354:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3fbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e2e expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.005374:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3400/0xa47abda6516d3fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e2e expref: 59 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.005445:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115527.005449:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789115527.005454:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d3400, rc 0) 00000100:00100000:0.0:1789115527.005527:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+59:11825:x1876023288360576:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 518us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115527.005537:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00080000:1.0:1789115527.005847:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115527.009267:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.009812:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288360704 00000100:00100000:0.0:1789115527.009825:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288360704 00000100:00100000:0.0:1789115527.009894:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:0.0:1789115527.009905:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+59:11825:x1876023288360704:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115527.009932:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115527.009958:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3fca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e35 expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010052:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d3fd1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010071:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d3fd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010083:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d3fd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010102:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d3fd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010109:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d3fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010117:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d3fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010248:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d3fdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010258:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d3fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010288:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d3fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115527.010332:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789115527.010337:0:8213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115527.010359:0:8213:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d3fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010372:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d3fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010422:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d3fd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010429:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d3fd1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010436:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d3fd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010442:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115527.010447:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d3fd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010455:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d3fd1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010468:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115527.010471:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115527.010477:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d3fd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010504:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d3fd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.010519:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d3fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.012222:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d3fd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.012230:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d3fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.012236:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115527.012241:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d3fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.012251:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d3fd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.012269:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcd044fc00) 00010000:00010000:0.0:1789115527.012272:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115527.012277:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d3fd8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.012284:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d3fd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.012348:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d3fca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e35 expref: 61 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.012365:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d3fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e35 expref: 60 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.012407:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:0.0:1789115527.012409:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789115527.012412:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d3600, rc 0) 00000100:00100000:0.0:1789115527.012513:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+60:11825:x1876023288360704:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2609us (3260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115527.012531:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:3.0:1789115527.018275:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115527.018344:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.018449:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288360960 00000100:00100000:0.0:1789115527.018462:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288360960 00000100:00100000:0.0:1789115527.018553:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:0.0:1789115527.018565:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+60:11825:x1876023288360960:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115527.018592:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115527.018970:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3fe6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e3c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.019125:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.019142:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e27 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.019152:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d3fdf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e35 expref: 61 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.019160:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.019206:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d3fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e35 expref: 61 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.019235:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d3fdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e35 expref: 61 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115527.019252:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308274176:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115527.019423:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e27 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.019433:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e27 expref: 61 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115527.019442:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf84b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308274304:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115527.019476:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd9705b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789115527.020105:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288361088 00000100:00100000:2.0:1789115527.020114:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288361088 00010000:00010000:2.0:1789115527.020154:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d3fdf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e35 expref: 62 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115527.020196:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:2.0:1789115527.020207:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12ada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+62:2351:x1876023288361088:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115527.020221:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115527.020227:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d3fdf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e35 expref: 62 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.020241:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d3fdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e35 expref: 62 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.020265:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:2.0:1789115527.020269:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.020278:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.020301:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115527.020356:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12ada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+62:2351:x1876023288361088:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 150us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115527.020365:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:3.0:1789115527.022919:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.023166:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf84b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308274304:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115527.023491:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288361216 00000100:00100000:2.0:1789115527.023509:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288361216 00010000:00010000:2.0:1789115527.023566:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e27 expref: 62 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115527.023762:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:2.0:1789115527.023775:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+62:2352:x1876023288361216:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115527.023794:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115527.023802:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e27 expref: 62 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.023816:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e27 expref: 62 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.023843:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d3fb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e27 expref: 62 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.023862:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:2.0:1789115527.023868:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.023879:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.023905:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.023926:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115527.023996:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+61:2352:x1876023288361216:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 223us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115527.024005:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00010000:00010000:0.0:1789115527.024173:0:5850:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.31@tcp) returned -22 from blocking AST (req@00000000ff7a1a2c x1876023308274176) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d3fdf lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e35 expref: 60 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.024189:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d3fdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e35 expref: 60 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115527.024201:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308274176:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115527.024230:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:0.0:1789115527.024237:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.024259:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.024265:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115527.024290:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789115527.025238:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d3fe6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e3c expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.025261:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e3c expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.025269:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:0.0:1789115527.025272:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789115527.025275:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d2e00, rc 0) 00000100:00100000:0.0:1789115527.025333:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+60:11825:x1876023288360960:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 6770us (7148us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789115527.025342:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:3.0:1789115527.031550:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115527.031613:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288361472 00000100:00100000:2.0:1789115527.031692:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288361472 00000100:00100000:2.0:1789115527.031784:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1789115527.031795:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce2939450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+60:11825:x1876023288361472:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:2.0:1789115527.031817:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115527.031848:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2400/0xa47abda6516d3f4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e12 expref: 60 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.031869:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:2.0:1789115527.031876:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115527.031953:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce2939450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dbf7574-92fb-4b89-af78-41319f924699+59:11825:x1876023288361472:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 160us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115527.032150:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1789115527.034090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115527.034232:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288361600 00000100:00100000:1.0:1789115527.034244:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288361600 00000100:00100000:1.0:1789115527.034310:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:1.0:1789115527.034322:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+59:11825:x1876023288361600:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:1.0:1789115527.034868:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ffb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.034891:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ffb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.035274:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ffb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789115527.038074:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789115527.038232:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+59:11825:x1876023288361600:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 3903us (4147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115527.038246:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:1.0:1789115527.043992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115527.044121:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288361728 00000100:00100000:3.0:1789115527.044134:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288361728 00000100:00100000:3.0:1789115527.044215:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:3.0:1789115527.044228:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+59:11825:x1876023288361728:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789115527.044259:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115527.044287:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d4002 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e43 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.044362:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ffb lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.044375:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d4002 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e43 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.044445:0:5851:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ffb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.044461:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d4002 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e43 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.044477:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:3.0:1789115527.044481:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789115527.044485:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d4002 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e43 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.045200:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ea600, rc 0) 00000100:00100000:3.0:1789115527.045297:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+60:11825:x1876023288361728:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1070us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115527.045307:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 214 00000040:00080000:2.0:1789115527.460374:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789115527.460429:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789115527.460481:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789115527.460488:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789115527.460940:0:12072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876023308274432:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789115527.461091:0:12072:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a8e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789115527.479794:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.479951:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288361856 00000100:00100000:0.0:1789115527.479963:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288361856 00000100:00100000:0.0:1789115527.480035:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:0.0:1789115527.480059:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcedabe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+61:11826:x1876023288361856:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789115527.480101:0:8213:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789115527.480238:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcedabe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+61:11826:x1876023288361856:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 183us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115527.480246:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:2.0:1789115527.480685:0:12072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876023308274432:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789115527.486251:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.486450:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288361984 00000100:00100000:0.0:1789115527.486462:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288361984 00000100:00100000:0.0:1789115527.486580:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:0.0:1789115527.486591:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+60:11826:x1876023288361984:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789115527.486659:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d4009 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.486675:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d4009 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.486686:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d4009 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.486701:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4010 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.486708:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4010 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.486714:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4010 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.487218:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d4017 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.487231:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d4017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.487238:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d4017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115527.487274:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789115527.487291:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115527.487305:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d4017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.487316:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d4009 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.487322:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d4009 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.487328:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d4009 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.487333:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115527.487337:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d4009 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488064:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d4009 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488086:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:0.0:1789115527.488089:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115527.488094:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d4009 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488102:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2200/0xa47abda6516d4009 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488118:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4010 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488124:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4010 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488143:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4010 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488149:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115527.488152:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4010 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488159:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4010 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488168:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8dfcd044fc00) 00010000:00010000:0.0:1789115527.488170:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115527.488173:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4010 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488178:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4010 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488195:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d4017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488201:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d4017 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488207:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d4017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488211:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115527.488214:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d4017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488229:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d4017 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488236:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:0.0:1789115527.488239:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115527.488241:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d4017 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.488246:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d4017 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115527.488342:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+60:11826:x1876023288361984:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 1751us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115527.488360:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:3.0:1789115527.495186:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.495328:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288362240 00000100:00100000:0.0:1789115527.495337:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288362240 00000100:00100000:0.0:1789115527.495429:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:0.0:1789115527.495439:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+60:11826:x1876023288362240:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115527.495463:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115527.495483:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d401e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e4a expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.495596:0:8213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d4025 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.495610:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d4025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.495621:0:8213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d4025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115527.495647:0:8213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789115527.495959:0:8213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d4025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.495968:0:8213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d4025 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.495974:0:8213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d4025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.495979:0:8213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115527.495983:0:8213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d4025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.495989:0:8213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d4025 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.496000:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:0.0:1789115527.496003:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789115527.496007:0:8213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d4025 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.496013:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d4025 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.496062:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d401e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e4a expref: 62 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.496072:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:0.0:1789115527.496074:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789115527.496087:0:8213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d401e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e4a expref: 62 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.496097:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d2600, rc 0) 00000100:00100000:0.0:1789115527.496160:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+61:11826:x1876023288362240:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 722us (984us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1789115527.496169:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:1.0:1789115527.505633:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115527.507718:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288362368 00000100:00100000:3.0:1789115527.507732:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288362368 00000100:00100000:3.0:1789115527.507856:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:3.0:1789115527.507868:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+61:11826:x1876023288362368:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789115527.507906:0:5851:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789115527.508025:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+61:11826:x1876023288362368:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 160us (2401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115527.508033:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:2.0:1789115527.517890:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115527.517984:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288362624 00000100:00100000:1.0:1789115527.517993:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288362624 00000100:00100000:1.0:1789115527.518055:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:1.0:1789115527.518076:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5738b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+61:11826:x1876023288362624:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789115527.518095:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115527.518099:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789115527.518124:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3400/0xa47abda6516d3fc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e2e expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.518142:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115527.518147:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789115527.518160:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d4033 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e51 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789115527.518598:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1789115527.518780:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d403a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.518793:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d403a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.518820:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d403a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.518871:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d4033 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e51 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.518886:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d403a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e51 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.518893:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:1.0:1789115527.518896:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115527.518899:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6800, rc 0) 00000100:00100000:1.0:1789115527.518962:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5738b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+62:11826:x1876023288362624:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 896us (1079us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1789115527.518969:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:1.0:1789115527.524586:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.524710:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288362880 00000100:00100000:0.0:1789115527.524720:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288362880 00000100:00100000:0.0:1789115527.524782:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:0.0:1789115527.524792:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+62:11826:x1876023288362880:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789115527.524871:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115527.524899:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d403a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e51 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.524917:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dfcd01aec00) 00010000:00010000:0.0:1789115527.524928:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115527.524949:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d4048 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.524961:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d4048 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.524970:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d4048 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.524982:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d404f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb190700f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.524988:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d404f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb190700f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.525003:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d404f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb190700f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.525987:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d4048 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.526000:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d4048 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.526007:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d4048 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.526013:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115527.526018:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d4048 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.526025:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d4048 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.526055:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:0.0:1789115527.526058:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115527.526063:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d4048 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.526078:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d4048 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.526100:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d404f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb190700f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.526107:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d404f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb190700f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.526123:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d404f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb190700f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.526128:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115527.526130:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d404f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb190700f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.526136:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d404f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb190700f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.526144:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb190700f (ffff8dfcd044fc00) 00010000:00010000:0.0:1789115527.526147:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115527.526154:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d404f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb190700f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.526161:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d404f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb190700f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115527.526305:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+61:11826:x1876023288362880:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1510us (1723us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789115527.526314:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:3.0:1789115527.532171:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115527.532259:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288363008 00000100:00100000:1.0:1789115527.532268:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288363008 00000100:00100000:1.0:1789115527.532350:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:1.0:1789115527.532361:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+61:11826:x1876023288363008:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789115527.532404:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115527.532428:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d4056 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e58 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.532490:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d405d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.532511:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d405d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.532522:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d405d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.532619:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d4056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e58 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.532637:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d405d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e58 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.532646:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dfcd01ae700) 00010000:00010000:1.0:1789115527.532649:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789115527.532653:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7000, rc 0) 00000100:00100000:1.0:1789115527.532716:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+62:11826:x1876023288363008:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 357us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115527.532734:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:2.0:1789115527.536711:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115527.536807:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288363264 00000100:00100000:3.0:1789115527.536877:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288363264 00000100:00100000:3.0:1789115527.536928:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:3.0:1789115527.536937:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+62:11826:x1876023288363264:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789115527.537020:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d4064 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.537066:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d4064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.537080:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d4064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789115527.537318:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1789115527.537327:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344749944099ns, next at 345749942111ns, rc = 0 00000004:00010000:3.0:1789115527.537627:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000edee2daa reply state 00000000193eda67 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d4064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115527.537637:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789115527.537736:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+64:11826:x1876023288363264:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 799us (1113us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1789115527.537744:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 222 00010000:00010000:1.0:1789115527.541356:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d4064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.541373:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d4064 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.541432:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d4064 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.541454:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eae00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115527.541460:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d4064 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.541468:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d4064 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.541485:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dfcd01ae700) 00010000:00010000:1.0:1789115527.541488:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789115527.541493:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d4064 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.541499:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eae00/0xa47abda6516d4064 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115527.547163:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.547592:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288363392 00000100:00100000:0.0:1789115527.547603:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288363392 00000100:00100000:0.0:1789115527.547657:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:0.0:1789115527.547670:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5739e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+63:11826:x1876023288363392:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115527.548009:0:8213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115527.548030:0:8213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d406b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e5f expref: -99 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.548101:0:8213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d406b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e5f expref: 64 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.548136:0:8213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d406b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e5f expref: 64 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.548155:0:8213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dfcd01ae700) 00010000:00010000:0.0:1789115527.548159:0:8213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789115527.548163:0:8213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d3800, rc 0) 00000100:00100000:0.0:1789115527.548231:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5739e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+64:11826:x1876023288363392:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 564us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115527.548238:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:3.0:1789115527.554583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.554951:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288363520 00000100:00100000:0.0:1789115527.554961:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288363520 00000100:00100000:0.0:1789115527.555024:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:0.0:1789115527.555034:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12aed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+9:2353:x1876023288363520:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789115527.556121:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12aed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+10:2353:x1876023288363520:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 1082us (1540us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789115527.556133:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:3.0:1789115527.565211:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115527.569667:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288363776 00000100:00100000:2.0:1789115527.569682:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288363776 00000100:00100000:2.0:1789115527.569832:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:2.0:1789115527.569843:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+64:11826:x1876023288363776:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789115527.570603:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+65:11826:x1876023288363776:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 759us (5397us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789115527.570613:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:0.0:1789115527.574375:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115527.574526:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288364032 00000100:00100000:3.0:1789115527.574536:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288364032 00000100:00100000:3.0:1789115527.574585:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:3.0:1789115527.574594:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+65:11826:x1876023288364032:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789115527.574703:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+65:11826:x1876023288364032:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 110us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115527.574711:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:3.0:1789115527.577027:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115527.577287:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288364160 00000100:00100000:1.0:1789115527.577296:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288364160 00000100:00100000:1.0:1789115527.577594:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:1.0:1789115527.577606:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc12ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+65:11826:x1876023288364160:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789115527.577626:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115527.577647:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d4072 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e66 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.577711:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d4079 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.578131:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d4079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.578145:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d4079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115527.578195:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115527.578213:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d4079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.578238:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d4072 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e66 expref: 67 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.578254:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d4079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e66 expref: 66 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.578262:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dfcd01ae700) 00010000:00010000:1.0:1789115527.578264:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789115527.578268:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7400, rc 0) 00000100:00100000:1.0:1789115527.578458:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc12ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+66:11826:x1876023288364160:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 854us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115527.578465:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:0.0:1789115527.589480:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115527.589619:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288364288 00000100:00100000:2.0:1789115527.589629:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288364288 00000100:00100000:2.0:1789115527.589684:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:2.0:1789115527.589693:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+10:2352:x1876023288364288:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789115527.589710:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115527.589738:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d4080 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e6d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789115527.589763:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3bc86, blocks: 0x1 00010000:00010000:2.0:1789115527.589781:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1789115527.589786:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115527.589795:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d4080 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e6d expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.589827:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d4080 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e6d expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.589839:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacc800, rc 0) 00000100:00100000:2.0:1789115527.589897:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dbf7574-92fb-4b89-af78-41319f924699+11:2352:x1876023288364288:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 205us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115527.589905:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:1.0:1789115527.592482:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115527.594186:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288364544 00000100:00100000:3.0:1789115527.594200:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288364544 00000100:00100000:3.0:1789115527.594271:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:3.0:1789115527.594281:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc89a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+66:11826:x1876023288364544:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789115527.594420:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc89a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+66:11826:x1876023288364544:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 140us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115527.594444:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:3.0:1789115527.606941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115527.607024:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288364672 00000100:00100000:2.0:1789115527.607032:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288364672 00000100:00100000:2.0:1789115527.607104:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1789115527.607114:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+11:11826:x1876023288364672:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789115527.607133:0:6885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115527.607151:0:6885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000938762de/0xa47abda6516d4087 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e74 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.607181:0:6885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d4080 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e6d expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.607189:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115527.607193:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115527.607200:0:6885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000938762de/0xa47abda6516d4087 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e74 expref: 12 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.607232:0:6885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d4080 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e6d expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.607259:0:6885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d4080 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e6d expref: 12 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115527.607273:0:6885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc57383c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6885:1876023308274560:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115527.607368:0:6885:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a8e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789115527.615427:0:6885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc57383c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6885:1876023308274560:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789115527.615462:0:6885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000938762de/0xa47abda6516d4087 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e74 expref: 12 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.615480:0:6885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacc600, rc 0) 00000100:00100000:2.0:1789115527.615549:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+12:11826:x1876023288364672:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 8436us (8615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115527.615559:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:1.0:1789115527.617027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115527.617214:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288364800 00000100:00100000:2.0:1789115527.617223:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288364800 00010000:00010000:2.0:1789115527.617259:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d4080 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e6d expref: 12 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115527.617347:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:2.0:1789115527.617358:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+12:2353:x1876023288364800:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115527.617372:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115527.617416:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d4080 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e6d expref: 12 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.617451:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d4080 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e6d expref: 12 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.617475:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbe78050/0xa47abda6516d4080 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e6d expref: 12 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.617492:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115527.617496:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115527.617504:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000938762de/0xa47abda6516d4087 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e74 expref: 11 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.617514:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000938762de/0xa47abda6516d4087 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e74 expref: 11 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.617561:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000938762de/0xa47abda6516d4087 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e74 expref: 11 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115527.617575:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc57383c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1876023308274688:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789115527.617651:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a8e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789115527.623287:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.624271:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288364928 00000100:00100000:0.0:1789115527.624282:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288364928 00002000:00100000:0.0:1789115527.624327:0:6702:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8dfcfc3c0f00 x1876023288364928/t0(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:343/0 lens 504/0 e 0 to 0 dl 1789115538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789115527.624338:0:6702:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcfc3c0f00 with x1876023288364928 ext(0->12) 00002000:00010000:0.0:1789115527.624343:0:6702:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfcfc3c0f00 00000100:00100000:0.0:1789115527.624373:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1789115527.624411:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6dbf7574-92fb-4b89-af78-41319f924699+12:2353:x1876023288364928:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789115527.624811:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6dbf7574-92fb-4b89-af78-41319f924699+14:2353:x1876023288364928:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 428us (1529us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789115527.624824:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00002000:00100000:0.0:1789115527.624832:0:6702:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8dfcfc3c0f00 x1876023288364928/t4294967320(0) o4->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:343/0 lens 504/448 e 0 to 0 dl 1789115538 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789115527.624839:0:6702:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcfc3c0f00 with x1876023288364928 ext(0->12) 00002000:00010000:0.0:1789115527.624843:0:6702:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfcfc3c0f00 00000100:00100000:2.0:1789115527.628171:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc57383c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1876023308274688:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789115527.628195:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115527.628244:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+13:2353:x1876023288364800:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 10888us (11224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115527.628255:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:3.0:1789115527.633488:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.633617:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288365056 00000100:00100000:0.0:1789115527.633626:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288365056 00000100:00100000:0.0:1789115527.633685:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:0.0:1789115527.633696:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+66:11826:x1876023288365056:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789115527.680858:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000004:00080000:0.0:1789115527.680881:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789115527.680897:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dfcd84276c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789115527.680901:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcd06e1600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcd84279c0 00000020:00080000:0.0:1789115527.680904:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcd06e1700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcff890c00 00000004:00080000:0.0:1789115527.680921:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:0.0:1789115527.680948:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000001:00080000:0.0:1789115527.680978:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:0.0:1789115527.680991:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dfcd88c0840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789115527.680994:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcc6401f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcd88c0300 00000020:00080000:0.0:1789115527.680997:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcc6401900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcfc3fd400 00000004:00080000:0.0:1789115527.681006:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:3.0:1789115527.681310:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308274816:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789115527.681371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115527.681463:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308274816 00000100:00100000:2.0:1789115527.681470:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308274816 00000100:00100000:2.0:1789115527.681527:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789115527.681536:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876023308274816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789115527.681559:0:6697:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1789115527.681589:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3bc85, atime: 0x6aa3bc85, ctime: 0x6aa3bc85, blocks: 0x1 00010000:00010000:2.0:1789115527.681596:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d408e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.681611:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1789115527.681615:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115527.681622:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d408e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.681637:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d408e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.681648:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d408e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.681655:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d408e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.681671:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789115527.682543:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308274944:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789115527.682582:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115527.682701:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+20:11826:x1876023288365056:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 49005us (49219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115527.682710:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:2.0:1789115527.682824:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1876023308274816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1288us (1450us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789115527.682831:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789115527.682852:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308274944 00000100:00100000:2.0:1789115527.682858:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308274944 00000100:00100000:2.0:1789115527.682942:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789115527.682949:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8824780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876023308274944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789115527.682966:0:6697:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1789115527.682984:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d590aadf/0xa47abda6516d4095 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.683000:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e104f16/0xa47abda6516d3e50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dd3 expref: 12 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.683008:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789115527.683012:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789115527.683016:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d590aadf/0xa47abda6516d4095 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789115527.683110:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789115527.683148:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e104f16/0xa47abda6516d3e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dd3 expref: 12 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.683163:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e104f16/0xa47abda6516d3e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dd3 expref: 12 pid: 6885 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115527.683176:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc57383c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6697:1876023308275072:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115527.683213:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee519780 going to sleep for 11 seconds 00000004:00080000:3.0:1789115527.683283:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dfcf50f30c0/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789115527.683290:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308274816:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789115527.683305:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115527.683312:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d408e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.683320:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc800 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115527.683323:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d408e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.683333:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d408e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.683350:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d408e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.683357:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d408e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.683424:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115527.683426:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115527.683427:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789115527.686260:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789115527.686468:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789115527.686923:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115527.686950:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288365184 00000100:00100000:1.0:1789115527.686970:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288365184 00010000:00010000:1.0:1789115527.687001:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e104f16/0xa47abda6516d3e50 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dd3 expref: 13 pid: 6885 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115527.687030:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:1.0:1789115527.687052:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8826d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+13:2352:x1876023288365184:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115527.687065:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115527.687070:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e104f16/0xa47abda6516d3e50 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dd3 expref: 13 pid: 6885 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.687083:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e104f16/0xa47abda6516d3e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dd3 expref: 13 pid: 6885 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.687107:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789115527.687112:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789115527.687117:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d590aadf/0xa47abda6516d4095 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.687127:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d590aadf/0xa47abda6516d4095 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.687145:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115527.687187:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8826d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+13:2352:x1876023288365184:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 150us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115527.687195:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:2.0:1789115527.687631:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308275200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789115527.687677:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789115527.687853:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e104f16/0xa47abda6516d3e50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3dd3 expref: 12 pid: 6885 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115527.687876:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc57383c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6697:1876023308275072:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115527.687895:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d590aadf/0xa47abda6516d4095 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.687905:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d590aadf/0xa47abda6516d4095 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.687912:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d590aadf/0xa47abda6516d4095 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.687922:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d590aadf/0xa47abda6516d4095 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.687930:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d590aadf/0xa47abda6516d4095 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.687943:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789115527.688485:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8824780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1876023308274944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5536us (5901us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789115527.688493:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789115527.688510:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308275200 00000100:00100000:0.0:1789115527.688514:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308275200 00010000:00010000:1.0:1789115527.688607:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115527.688614:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d590aadf/0xa47abda6516d4095 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.688629:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacdc00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115527.688633:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d590aadf/0xa47abda6516d4095 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.688642:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d590aadf/0xa47abda6516d4095 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.688654:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d590aadf/0xa47abda6516d4095 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.688661:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d590aadf/0xa47abda6516d4095 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.688679:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115527.688681:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115527.688683:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789115527.688801:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dfcfc3bc000/2, rc 0, transno 4294967321 00000100:00100000:2.0:1789115527.688807:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308274944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789115527.688938:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789115527.688946:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1876023308275200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789115527.689067:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789115527.689071:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789115526 00002000:00010000:0.0:1789115527.689073:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789115527.689075:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789115526 -> 1789115526 00002000:00010000:0.0:1789115527.689078:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789115527.689128:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3307:x1876023308275200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (1450us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789115527.689135:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1789115527.689185:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dfcfc3bda40/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789115527.689190:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308275200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789115527.691204:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.691286:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288365312 00000100:00100000:0.0:1789115527.691294:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288365312 00000100:00100000:0.0:1789115527.691366:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:0.0:1789115527.691375:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+12:2352:x1876023288365312:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789115527.736103:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+12:2352:x1876023288365312:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 44720us (44897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115527.736117:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000001:00080000:3.0:1789115527.736156:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1789115527.736168:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1789115527.739554:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115527.739649:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288365568 00000100:00100000:1.0:1789115527.739658:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288365568 00000100:00100000:1.0:1789115527.739723:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 228 00000100:00100000:1.0:1789115527.739733:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc085680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+20:11826:x1876023288365568:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789115527.739783:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115527.739809:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7400/0xa47abda6516d4079 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e66 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.739838:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dfcd01ae700) 00010000:00010000:1.0:1789115527.739854:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789115527.739885:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d409c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.739898:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d409c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.739907:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d409c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789115527.740533:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008a314ecc reply state 00000000c8e16f79 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d409c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115527.740544:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789115527.740641:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc085680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+21:11826:x1876023288365568:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 908us (1095us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789115527.740649:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 228 00010000:00010000:0.0:1789115527.750793:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d409c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.750817:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d409c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.750826:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d409c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.750832:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115527.750837:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d409c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.750845:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d409c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.750864:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dfcd01ae700) 00010000:00010000:0.0:1789115527.750883:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115527.750889:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d409c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.750896:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d409c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115527.751790:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115527.751875:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288365696 00000100:00100000:2.0:1789115527.751884:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288365696 00000100:00100000:2.0:1789115527.751939:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:2.0:1789115527.751949:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc085e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2352:x1876023288365696:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789115527.752201:0:6885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789115527.752205:0:6885:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789115526 -> 1789115526 00002000:00010000:2.0:1789115527.752208:0:6885:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789115525 00002000:00010000:2.0:1789115527.752210:0:6885:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789115526 -> 1789115526 00002000:00010000:2.0:1789115527.752213:0:6885:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789115527.752276:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc085e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+8:2352:x1876023288365696:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 328us (493us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789115527.752284:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:1.0:1789115527.755932:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.756026:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288365952 00000100:00100000:0.0:1789115527.756098:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288365952 00000100:00100000:0.0:1789115527.756242:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:0.0:1789115527.756252:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+20:11826:x1876023288365952:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789115527.756316:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.756332:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d405d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e58 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.756341:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.756371:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d405d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e58 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.756410:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d405d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e58 expref: 20 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115527.756425:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3be580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876023308275328:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115527.756506:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd965e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789115527.760003:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.760310:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3be580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876023308275328:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115527.760349:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115527.760422:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288366080 00000100:00100000:1.0:1789115527.760428:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288366080 00010000:00010000:1.0:1789115527.760462:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d405d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e58 expref: 21 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115527.760550:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:1.0:1789115527.760561:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+21:2353:x1876023288366080:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115527.760574:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115527.760581:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d405d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e58 expref: 21 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.760592:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d405d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e58 expref: 21 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.760621:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7000/0xa47abda6516d405d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e58 expref: 21 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.760637:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dfcd01ae700) 00010000:00010000:1.0:1789115527.760642:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.760652:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.760660:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.760687:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115527.760737:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+20:2353:x1876023288366080:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 178us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115527.760746:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 90 00010000:00010000:0.0:1789115527.760792:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.760799:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.760824:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.760831:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.760838:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.760844:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115527.760848:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.760855:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.760863:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dfcd01ae700) 00010000:00010000:0.0:1789115527.760866:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789115527.760870:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.760876:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115527.760929:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+19:11826:x1876023288365952:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 4678us (5005us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789115527.760936:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:0.0:1789115527.763072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115527.763501:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288366208 00000100:00100000:2.0:1789115527.763510:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288366208 00000100:00100000:2.0:1789115527.763650:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:2.0:1789115527.763660:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288366208:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789115527.763703:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009444b9c1/0xa47abda6516d40aa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.763722:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000938762de/0xa47abda6516d4087 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e74 expref: 8 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.763733:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115527.763737:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789115527.763754:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009444b9c1/0xa47abda6516d40aa lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.763787:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000938762de/0xa47abda6516d4087 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e74 expref: 8 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.763800:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000938762de/0xa47abda6516d4087 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e74 expref: 8 pid: 6885 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115527.763814:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1876023308275456:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115527.763890:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd88c06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115527.766459:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1876023308275456:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115527.766469:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:2.0:1789115527.766487:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009444b9c1/0xa47abda6516d40aa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115527.767124:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288366336 00000100:00100000:1.0:1789115527.767132:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288366336 00010000:00010000:1.0:1789115527.767169:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000938762de/0xa47abda6516d4087 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e74 expref: 9 pid: 6885 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115527.767215:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:1.0:1789115527.767225:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9703c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+9:2353:x1876023288366336:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115527.767244:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115527.767266:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000938762de/0xa47abda6516d4087 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e74 expref: 9 pid: 6885 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.767298:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000938762de/0xa47abda6516d4087 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e74 expref: 9 pid: 6885 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.767321:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000938762de/0xa47abda6516d4087 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e74 expref: 9 pid: 6885 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.767337:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789115527.767341:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789115527.767347:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009444b9c1/0xa47abda6516d40aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.767357:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009444b9c1/0xa47abda6516d40aa lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.767410:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115527.767460:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9703c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+8:2353:x1876023288366336:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 236us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115527.767468:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00010000:00010000:3.0:1789115527.767779:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009444b9c1/0xa47abda6516d40aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.767789:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009444b9c1/0xa47abda6516d40aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.767811:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009444b9c1/0xa47abda6516d40aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.767819:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009444b9c1/0xa47abda6516d40aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.767833:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009444b9c1/0xa47abda6516d40aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.767840:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacd600 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115527.767844:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009444b9c1/0xa47abda6516d40aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.767853:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009444b9c1/0xa47abda6516d40aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.767864:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009444b9c1/0xa47abda6516d40aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.767871:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009444b9c1/0xa47abda6516d40aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115527.767931:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2353:x1876023288366208:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 4272us (4867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115527.767939:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:3.0:1789115527.770224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115527.770375:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288366592 00000100:00100000:2.0:1789115527.770656:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288366592 00000100:00100000:2.0:1789115527.770745:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 230 00000100:00100000:2.0:1789115527.770755:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff971a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+19:11826:x1876023288366592:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789115527.770835:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d40b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.770852:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d40b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.770865:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d40b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.771090:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.771100:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d406b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e5f expref: 20 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.771108:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.771138:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d406b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e5f expref: 20 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115527.771152:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d406b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e5f expref: 20 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115527.771165:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308275584:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115527.771246:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd88c06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789115527.775942:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115527.776013:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288366720 00000100:00100000:3.0:1789115527.776022:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288366720 00010000:00010000:3.0:1789115527.776072:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d406b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e5f expref: 21 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115527.776134:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:3.0:1789115527.776145:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83afc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+21:2352:x1876023288366720:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115527.776160:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115527.776168:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d406b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e5f expref: 21 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.776180:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d406b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e5f expref: 21 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.776211:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dfcd01ae700) 00010000:00010000:3.0:1789115527.776216:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.776225:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.776232:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.776252:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115527.776308:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83afc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dbf7574-92fb-4b89-af78-41319f924699+21:2352:x1876023288366720:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 164us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115527.776316:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00010000:00010000:2.0:1789115527.776647:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3800/0xa47abda6516d406b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e5f expref: 20 pid: 8213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115527.776665:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308275584:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789115527.776687:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.779486:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.779702:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789115527.779893:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1789115527.780050:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1789115527.780166:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1789115527.780259:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1876023308275712:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789115527.780327:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115527.780754:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233780 going to sleep for 11 seconds 00000100:00100000:2.0:1789115527.781934:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308275712 00000100:00100000:2.0:1789115527.781945:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308275712 00000100:00100000:2.0:1789115527.782069:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789115527.782092:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876023308275712:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789115527.782212:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876023308275712:12345-0@lo:1000:mdt00_000.0 Request processed in 122us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115527.782220:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789115527.782318:0:5850:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1789115527.782325:0:5850:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1789115527.782352:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dfcfc3bc000, transno 4294967321 00000004:00080000:3.0:1789115527.782447:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dfcfc3bda40, transno 4294967322 00000100:00100000:3.0:1789115527.783291:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1876023308275712:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789115527.784894:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1789115527.784983:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1876023308275840:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789115527.785083:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115527.785119:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1241600 going to sleep for 11 seconds 00000100:00100000:1.0:1789115527.785532:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308275840 00000100:00100000:1.0:1789115527.785540:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308275840 00000100:00100000:1.0:1789115527.785597:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789115527.785606:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1876023308275840:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789115527.785802:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5850:x1876023308275840:12345-0@lo:1000:mdt00_000.0 Request processed in 197us (719us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789115527.785826:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789115527.785857:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1876023308275840:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789115527.785892:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.785900:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.785905:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.785909:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115527.785912:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.785923:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.785936:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dfcd01ae700) 00010000:00010000:3.0:1789115527.785937:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789115527.785941:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.785945:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc200/0xa47abda6516d40b8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.785968:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ffb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.785974:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ffb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.785979:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ffb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.785983:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115527.785986:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ffb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.785992:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ffb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.785999:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:3.0:1789115527.786001:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789115527.786008:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d4002 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e43 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.786050:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d4002 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e43 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.786063:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d4002 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e43 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.786090:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d4002 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e43 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115527.786099:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09f840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308275968:192.168.203.31@tcp:105: 00000100:00100000:3.0:1789115527.786200:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1241600 going to sleep for 11 seconds 00000100:00100000:3.0:1789115527.790686:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09f840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876023308275968:192.168.203.31@tcp:105: 00000100:00100000:1.0:1789115527.790700:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:3.0:1789115527.790712:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ffb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790721:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d3ffb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790747:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d40bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790758:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d40bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790767:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d40bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790775:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d40bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790790:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d40bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790794:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d40bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790797:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115527.790800:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d40bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790804:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d40bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790812:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:3.0:1789115527.790814:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115527.790816:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d40bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790820:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea800/0xa47abda6516d40bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790826:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d40b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790829:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d40b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790834:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d40b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790839:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacca00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115527.790846:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d40b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790853:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d40b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790861:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:3.0:1789115527.790863:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789115527.790866:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d40b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.790872:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacca00/0xa47abda6516d40b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115527.791110:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff971a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+23:11826:x1876023288366592:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 20354us (20892us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789115527.791121:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 230 00000020:00080000:3.0:1789115527.791126:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789115527.791161:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789115527.791167:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1789115527.792113:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288366848 00000100:00100000:0.0:1789115527.792124:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288366848 00000040:00080000:2.0:1789115527.792575:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789115527.792586:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789115527.792851:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1789115527.792862:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+23:11825:x1876023288366848:12345-192.168.203.31@tcp:49:lfs.0 00000100:00100000:0.0:1789115527.792995:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+23:11825:x1876023288366848:12345-192.168.203.31@tcp:49:lfs.0 Request processed in 135us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115527.793002:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:3.0:1789115527.795301:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115527.795369:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288367104 00000100:00100000:0.0:1789115527.795460:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288367104 00000100:00100000:0.0:1789115527.795777:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:0.0:1789115527.795968:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88a7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+23:11826:x1876023288367104:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789115527.797180:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115527.797274:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288367360 00000100:00100000:2.0:1789115527.797281:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288367360 00000100:00100000:2.0:1789115527.797335:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:2.0:1789115527.797344:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+24:11825:x1876023288367360:12345-192.168.203.31@tcp:58:lfs.0 00000040:00080000:2.0:1789115527.797669:0:8213:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000004:00080000:1.0:1789115527.799007:0:5854:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789115527.799138:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1789115527.799188:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.799204:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.799215:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.799224:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.799231:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.799237:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.799272:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789115527.799306:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115527.799315:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.799324:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6800 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115527.799329:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.799338:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.799351:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dfcd01aee00) 00010000:00010000:0.0:1789115527.799362:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789115527.799368:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40c6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115527.799373:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115527.799422:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+26:11825:x1876023288367360:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 2074us (2243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115527.799432:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 231 00010000:00010000:0.0:1789115527.799477:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115527.799480:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115527.799482:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115527.800221:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88a7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+25:11826:x1876023288367104:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 4427us (4920us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789115527.800234:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000020:00080000:1.0:1789115527.800239:0:5854:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789115527.827219:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115527.827988:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288367488 00000100:00100000:1.0:1789115527.827999:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288367488 00000100:00100000:1.0:1789115527.828117:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 232 00000100:00100000:1.0:1789115527.828127:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+25:11828:x1876023288367488:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1789115527.828150:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115527.828171:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d40cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e7b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.828230:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d40d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.828244:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d40d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.828255:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d40d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.828271:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.828278:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.828285:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.828596:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d40e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.828607:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e3c expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.828615:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d40e2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.828655:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e3c expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.828667:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e3c expref: 26 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115527.828680:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc83ad680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308276096:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115527.829101:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfce0416540 going to sleep for 11 seconds 00000100:00100000:0.0:1789115527.831454:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115527.831524:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288367744 00000100:00100000:2.0:1789115527.831532:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288367744 00000100:00100000:2.0:1789115527.831590:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:2.0:1789115527.831599:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+27:5591:x1876023288367744:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789115527.831825:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+28:5591:x1876023288367744:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 226us (377us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1789115527.831834:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:1.0:1789115527.832369:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc83ad680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876023308276096:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115527.832416:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d40e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115527.835674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115527.835784:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288367872 00000100:00100000:1.0:1789115527.835794:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288367872 00010000:00010000:1.0:1789115527.835945:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e3c expref: 28 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115527.835985:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:1.0:1789115527.835994:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5738f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+28:2352:x1876023288367872:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115527.836009:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115527.836016:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e3c expref: 28 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.836028:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e3c expref: 28 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.836081:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2e00/0xa47abda6516d3fed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e3c expref: 28 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.836098:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:1.0:1789115527.836103:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d40e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.836112:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d40e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.836120:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d40e2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115527.836154:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115527.836350:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5738f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dbf7574-92fb-4b89-af78-41319f924699+27:2352:x1876023288367872:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 355us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115527.836359:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00010000:00010000:3.0:1789115527.836494:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d40e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836502:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d40e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115527.836543:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789115527.836547:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789115527.836565:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d40e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836575:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d40e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836590:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d40d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836596:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d40d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836602:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d40d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836608:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115527.836612:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d40d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836620:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d40d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836630:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:3.0:1789115527.836633:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115527.836637:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d40d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836642:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6c00/0xa47abda6516d40d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836654:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836660:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836666:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836677:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115527.836680:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836686:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836695:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dfcd01ae400) 00010000:00010000:3.0:1789115527.836697:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115527.836700:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836705:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6800/0xa47abda6516d40db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836739:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6a00/0xa47abda6516d40cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e7b expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836763:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d40e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e7b expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115527.836769:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:3.0:1789115527.836771:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789115527.836774:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7800, rc 0) 00000100:00100000:3.0:1789115527.836803:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+26:11828:x1876023288367488:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 8678us (9593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115527.836810:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 232 00010000:00010000:3.0:1789115527.908415:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789115528.334453:0:13002:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789115528.334461:0:13002:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789115528.334506:0:13002:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789115528.334512:0:13002:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789115528.677949:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115528.677999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115528.678049:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115528.678174:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288368384 00000100:00100000:2.0:1789115528.678183:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288368384 00000100:00100000:2.0:1789115528.678268:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:2.0:1789115528.678278:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2350:x1876023288368384:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115528.678349:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2350:x1876023288368384:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 72us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115528.678356:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00080000:0.0:1789115528.679291:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789115528.679429:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115528.679468:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115528.679619:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288368000 00000100:00100000:0.0:1789115528.679627:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288368000 00000100:00100000:0.0:1789115528.679666:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 326 00000100:00100000:0.0:1789115528.679675:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288368000:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115528.679730:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288368000:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 57us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115528.679737:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 326 00000100:00100000:2.0:1789115528.679875:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288368256 00000100:00100000:2.0:1789115528.679880:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288368256 00000100:00100000:2.0:1789115528.679923:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:2.0:1789115528.679931:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+7:2350:x1876023288368256:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115528.679959:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+7:2350:x1876023288368256:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115528.679966:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00080000:0.0:1789115528.682603:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789115528.688164:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288368128 00000100:00100000:1.0:1789115528.688182:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288368128 00000100:00100000:1.0:1789115528.688328:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288368512 00000100:00100000:1.0:1789115528.688332:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288368512 00000100:00080000:0.0:1789115528.688411:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115528.688616:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:3.0:1789115528.688629:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+26:2350:x1876023288368128:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115528.688756:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+26:2350:x1876023288368128:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 131us (10815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115528.688764:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:3.0:1789115528.688780:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 169 00000100:00100000:3.0:1789115528.688786:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2350:x1876023288368512:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115528.688810:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2350:x1876023288368512:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (9343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115528.688816:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 169 00000040:00080000:2.0:1789115528.804006:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789115528.804015:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789115528.804061:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789115528.804068:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789115528.804184:0:12072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5739a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876023308276224:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789115528.804283:0:12072:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd88c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1789115528.814723:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115528.814899:0:12072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5739a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876023308276224:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789115528.823859:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288368640 00000100:00100000:0.0:1789115528.823874:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288368640 00000100:00100000:0.0:1789115528.824089:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:0.0:1789115528.824101:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+26:11840:x1876023288368640:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789115528.824131:0:5850:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789115528.824284:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+26:11840:x1876023288368640:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 186us (9569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115528.824292:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:3.0:1789115528.832620:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115528.832819:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288368896 00000100:00100000:1.0:1789115528.832829:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288368896 00000100:00100000:1.0:1789115528.832886:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:1.0:1789115528.832895:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+26:11840:x1876023288368896:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789115528.832928:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115528.832950:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d40e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115528.833067:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d40f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115528.833082:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d40f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115528.833094:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d40f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115528.833104:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789115528.833218:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac6e00/0xa47abda6516d40e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e82 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115528.833237:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d40f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e82 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115528.833245:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:1.0:1789115528.833248:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115528.833251:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7200, rc 0) 00000100:00100000:1.0:1789115528.833321:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+28:11840:x1876023288368896:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 426us (709us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789115528.833328:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:3.0:1789115528.848510:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115528.848626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115528.848735:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288369152 00000100:00100000:0.0:1789115528.848745:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288369152 00000100:00100000:0.0:1789115528.848803:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:0.0:1789115528.848813:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf52d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+28:11840:x1876023288369152:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789115528.848891:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115528.848908:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115528.848920:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115528.849116:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115528.849124:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115528.849130:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115528.849135:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115528.849140:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115528.849146:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115528.849158:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:0.0:1789115528.849161:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789115528.849178:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115528.849185:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2600/0xa47abda6516d40fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115528.849349:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf52d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dbf7574-92fb-4b89-af78-41319f924699+29:11840:x1876023288369152:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 536us (722us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789115528.849358:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:1.0:1789115528.849721:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288369280 00000100:00100000:1.0:1789115528.849728:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288369280 00000100:00100000:1.0:1789115528.849780:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:1.0:1789115528.849797:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce2938050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+29:2352:x1876023288369280:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115528.849813:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115528.849828:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7200/0xa47abda6516d40f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e82 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115528.849839:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:1.0:1789115528.849842:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115528.849876:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce2938050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dbf7574-92fb-4b89-af78-41319f924699+28:2352:x1876023288369280:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 82us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115528.849882:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000040:00080000:3.0:1789115528.850145:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789115528.850150:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789115528.850670:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789115528.850678:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789115528.864214:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115528.865578:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288369536 00000100:00100000:0.0:1789115528.865591:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288369536 00000100:00100000:0.0:1789115528.865665:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:0.0:1789115528.865675:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+28:11840:x1876023288369536:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789115528.865919:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+29:11840:x1876023288369536:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 244us (1713us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789115528.865928:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:0.0:1789115528.867654:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5739a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308276352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789115528.867728:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115528.867880:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308276352 00000100:00100000:2.0:1789115528.867888:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308276352 00000100:00100000:2.0:1789115528.867946:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789115528.867956:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876023308276352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789115528.867986:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115528.868049:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876023308276352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115528.868071:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789115528.868114:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5739a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308276352:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789115528.868481:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789115528.933416:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789115529.412968:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1789115529.413197:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:2.0:1789115529.892578:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308276736:0@lo:400:kworker.0 00000100:00100000:2.0:1789115529.892641:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115529.892689:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789115529.892694:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308276864:0@lo:400:kworker.0 00000100:00100000:2.0:1789115529.892725:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115529.892754:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308276864 00000100:00100000:2.0:1789115529.892760:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308276864 00000100:00100000:2.0:1789115529.892797:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789115529.892804:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5184b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308276864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115529.892845:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5184b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308276864:12345-0@lo:400:kworker.0 Request processed in 41us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115529.892852:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789115529.892880:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789115529.892885:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1789115529.892903:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dfcf50f30c0, transno 4294967310 00000100:00100000:2.0:1789115529.892912:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308276864:0@lo:400:kworker.0 00000100:00100000:1.0:1789115529.893110:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308276608:0@lo:400:kworker.0 00000100:00100000:1.0:1789115529.893137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115529.893155:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc57383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308277120:0@lo:400:kworker.0 00000100:00100000:1.0:1789115529.893172:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115529.893192:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789115529.893197:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5739a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308276480:0@lo:400:kworker.0 00000100:00100000:1.0:1789115529.893218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115529.893235:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308276992:0@lo:400:kworker.0 00000100:00100000:1.0:1789115529.893252:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115529.893272:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308276736 00000100:00100000:1.0:1789115529.893275:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308276736 00000100:00100000:1.0:1789115529.893302:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308276608 00000100:00100000:1.0:1789115529.893304:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308276608 00000100:00100000:1.0:1789115529.893313:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308276992 00000100:00100000:1.0:1789115529.893315:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308276992 00000100:00100000:1.0:1789115529.893326:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789115529.893343:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308276736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115529.893375:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308276736:12345-0@lo:400:kworker.0 Request processed in 32us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115529.893400:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789115529.893411:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789115529.893417:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308276608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115529.893442:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308276608:12345-0@lo:400:kworker.0 Request processed in 25us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115529.893447:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789115529.893457:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789115529.893462:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308276992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115529.893484:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308276992:12345-0@lo:400:kworker.0 Request processed in 23us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115529.893490:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789115529.893507:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308277120 00000100:00100000:1.0:1789115529.893510:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308277120 00000100:00100000:1.0:1789115529.893529:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789115529.893534:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876023308277120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115529.893557:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876023308277120:12345-0@lo:400:kworker.0 Request processed in 23us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115529.893562:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789115529.893575:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308276480 00000100:00100000:1.0:1789115529.893577:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308276480 00000100:00100000:1.0:1789115529.893593:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789115529.893598:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308276480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115529.893620:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3306:x1876023308276480:12345-0@lo:400:kworker.0 Request processed in 22us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115529.893631:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789115529.893667:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5739a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d846835-79f9-4361-81d5-b56fc2e9378a:3306:1876023308276480:0@lo:400:kworker.0 00000100:00100000:1.0:1789115529.893677:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308276992:0@lo:400:kworker.0 00000100:00100000:1.0:1789115529.893685:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308276608:0@lo:400:kworker.0 00000100:00100000:1.0:1789115529.893693:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc57383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308277120:0@lo:400:kworker.0 00000100:00100000:1.0:1789115529.893733:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308276736:0@lo:400:kworker.0 00000100:00080000:0.0:1789115529.894039:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789115529.894044:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789115529.955558:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789115530.180646:0:13055:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789115530.180656:0:13055:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789115530.180858:0:13055:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789115530.180865:0:13055:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789115530.340271:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115530.341168:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288369792 00000100:00100000:2.0:1789115530.341180:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288369792 00000100:00100000:2.0:1789115530.341291:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 236 00000100:00100000:2.0:1789115530.341303:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+29:11861:x1876023288369792:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789115530.341326:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115530.341347:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d4105 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e89 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115530.341503:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d410c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115530.341519:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d410c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115530.341532:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d410c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115530.341544:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789115530.341664:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacc000/0xa47abda6516d4105 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e89 expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115530.341683:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d410c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e89 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115530.341691:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:2.0:1789115530.341694:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789115530.341698:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacd200, rc 0) 00000100:00100000:2.0:1789115530.341757:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+31:11861:x1876023288369792:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 458us (1495us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789115530.341766:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 236 00000100:00080000:0.0:1789115530.341825:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115530.349229:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115530.349315:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288369920 00000100:00100000:0.0:1789115530.349325:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288369920 00000100:00100000:0.0:1789115530.349412:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 237 00000100:00100000:0.0:1789115530.349422:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+31:11861:x1876023288369920:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:0.0:1789115530.349488:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d411a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115530.349506:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d411a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115530.349518:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d411a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115530.349540:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d411a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115530.349547:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d411a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115530.349553:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d411a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115530.349559:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115530.349563:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d411a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115530.349570:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d411a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115530.349581:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:0.0:1789115530.349584:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789115530.349600:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d411a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115530.349607:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d411a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115530.349675:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dbf7574-92fb-4b89-af78-41319f924699+31:11861:x1876023288369920:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 254us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115530.349683:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 237 00000100:00100000:3.0:1789115530.404345:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789115530.404398:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308277248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115530.404462:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115530.404663:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308277248 00000100:00100000:1.0:1789115530.404670:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308277248 00000100:00100000:1.0:1789115530.404721:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789115530.404731:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaa73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308277248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789115530.404765:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115530.404813:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaa73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308277248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115530.404822:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789115530.404849:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc8826d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308277248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115530.436516:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115530.436610:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288370048 00000100:00100000:2.0:1789115530.436619:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288370048 00000100:00100000:2.0:1789115530.436682:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:2.0:1789115530.436691:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2351:x1876023288370048:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:2.0:1789115530.436720:0:6885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115530.436740:0:6885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dad810a/0xa47abda6516d4121 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e90 expref: -99 pid: 6885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789115530.436764:0:6885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa3bc86, atime: 0x6aa3bc85, ctime: 0x6aa3bc86, blocks: 0xb 00010000:00010000:2.0:1789115530.436784:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1789115530.436788:0:6885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115530.436798:0:6885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dad810a/0xa47abda6516d4121 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e90 expref: 8 pid: 6885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115530.436815:0:6885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002dad810a/0xa47abda6516d4121 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e90 expref: 8 pid: 6885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115530.436827:0:6885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacc000, rc 0) 00000100:00080000:0.0:1789115530.436925:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789115530.436964:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+8:2351:x1876023288370048:12345-192.168.203.31@tcp:101:cat.0 Request processed in 273us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115530.436971:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:2.0:1789115530.446329:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115530.446422:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288370176 00000100:00100000:3.0:1789115530.446433:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288370176 00002000:00100000:3.0:1789115530.446484:0:6704:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8dfcf5187c00 x1876023288370176/t0(0) o3->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:346/0 lens 488/0 e 0 to 0 dl 1789115541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789115530.446497:0:6704:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcf5187c00 with x1876023288370176 ext(0->4095) 00002000:00010000:3.0:1789115530.446502:0:6704:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfcf5187c00 00000100:00100000:3.0:1789115530.446530:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1789115530.446540:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5187c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:2350:x1876023288370176:12345-192.168.203.31@tcp:3:cat.0 00000100:00100000:3.0:1789115530.446722:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5187c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6dbf7574-92fb-4b89-af78-41319f924699+8:2350:x1876023288370176:12345-192.168.203.31@tcp:3:cat.0 Request processed in 184us (403us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789115530.446727:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00002000:00100000:3.0:1789115530.446732:0:6704:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8dfcf5187c00 x1876023288370176/t0(0) o3->6dbf7574-92fb-4b89-af78-41319f924699@192.168.203.31@tcp:346/0 lens 488/4536 e 0 to 0 dl 1789115541 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789115530.446738:0:6704:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8dfcf5187c00 with x1876023288370176 ext(0->4095) 00002000:00010000:3.0:1789115530.446740:0:6704:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dfcf5187c00 00010000:00010000:3.0:1789115530.980241:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115532.007216:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789115533.023806:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:0.0:1789115533.023957:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1789115533.023987:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1789115533.024022:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dfcd1233900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789115533.024028:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcd973e700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcd1233780 00000020:00080000:0.0:1789115533.024032:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dfcd973ed00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dfcfc3b8000 00000020:00080000:1.0:1789115533.025108:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789115533.025347:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1789115533.028539:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789115533.041686:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1789115533.041701:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:0.0:1789115533.798073:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115533.798116:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115533.798142:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115533.798162:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115533.798198:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115533.798229:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288370560 00000100:00100000:0.0:1789115533.798239:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288370560 00000100:00100000:0.0:1789115533.798293:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288370688 00000100:00100000:0.0:1789115533.798296:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288370688 00000100:00100000:0.0:1789115533.798321:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:0.0:1789115533.798330:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc83afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2350:x1876023288370560:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115533.798428:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc83afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2350:x1876023288370560:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 98us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115533.798441:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:0.0:1789115533.798458:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:0.0:1789115533.798465:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2572940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2350:x1876023288370688:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115533.798513:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2572940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2350:x1876023288370688:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 48us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115533.798520:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:0.0:1789115533.798540:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288370816 00000100:00100000:0.0:1789115533.798544:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288370816 00000100:00100000:0.0:1789115533.798569:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288370432 00000100:00100000:0.0:1789115533.798572:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288370432 00000100:00100000:0.0:1789115533.798588:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:0.0:1789115533.798593:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2350:x1876023288370816:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115533.798621:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:2350:x1876023288370816:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115533.798627:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:0.0:1789115533.798639:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:0.0:1789115533.798645:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4c26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+18:2350:x1876023288370432:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115533.798671:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4c26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+18:2350:x1876023288370432:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115533.798677:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00080000:0.0:1789115533.798699:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789115533.798704:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789115533.798706:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789115533.799038:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288370304 00000100:00100000:2.0:1789115533.799044:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288370304 00000100:00100000:2.0:1789115533.799078:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 328 00000100:00100000:2.0:1789115533.799086:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288370304:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115533.799122:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288370304:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 37us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115533.799141:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 328 00000100:00100000:2.0:1789115533.988672:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf51861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308277376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789115533.988741:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115533.996372:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308277376 00000100:00100000:2.0:1789115534.000664:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308277376 00000100:00100000:2.0:1789115534.000752:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789115534.000764:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5738780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308277376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789115534.000797:0:12414:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115534.000871:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5738780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308277376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (12131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115534.000878:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789115534.000931:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf51861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308277376:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789115534.001262:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789115534.052944:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115534.661860:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115534.661951:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288370944 00000100:00100000:3.0:1789115534.661962:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288370944 00000100:00100000:3.0:1789115534.662028:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 238 00000100:00100000:3.0:1789115534.662039:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2570780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+18:11506:x1876023288370944:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789115534.662152:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2570780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+18:11506:x1876023288370944:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 Request processed in 115us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115534.662169:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 238 00000100:00100000:2.0:1789115534.667075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115534.667408:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288371200 00000100:00100000:0.0:1789115534.667417:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288371200 00000100:00100000:1.0:1789115534.667650:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:1.0:1789115534.667664:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+18:11506:x1876023288371200:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789115534.668207:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+19:11506:x1876023288371200:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 545us (1138us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789115534.668217:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:2.0:1789115534.861464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115534.861549:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288371328 00000100:00100000:0.0:1789115534.861559:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288371328 00000100:00100000:0.0:1789115534.861642:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 239 00000100:00100000:0.0:1789115534.861653:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+5:12312:x1876023288371328:12345-192.168.203.31@tcp:101:lsof.0 00010000:00010000:0.0:1789115534.861673:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115534.861694:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d4128 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3e97 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115534.861754:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d412f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115534.861769:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d412f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115534.861783:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d412f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115534.861998:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789115534.862003:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115534.862093:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d412f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115534.862119:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3e00/0xa47abda6516d4128 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e97 expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115534.862134:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d412f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e97 expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115534.862143:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:0.0:1789115534.862155:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789115534.862159:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d3600, rc 0) 00000100:00100000:0.0:1789115534.862224:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:12312:x1876023288371328:12345-192.168.203.31@tcp:101:lsof.0 Request processed in 573us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115534.862232:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 239 00000040:00080000:2.0:1789115535.011685:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789115535.011694:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789115535.011969:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789115535.011977:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789115535.012369:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc1165a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308277888:0@lo:400:kworker.0 00000100:00100000:2.0:1789115535.012406:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc1166d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308277760:0@lo:400:kworker.0 00000100:00100000:1.0:1789115535.012475:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308277632:0@lo:400:kworker.0 00000100:00100000:0.0:1789115535.012513:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcf50e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308277504:0@lo:400:kworker.0 00000100:00100000:3.0:1789115535.012862:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115535.012929:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308277888 00000100:00100000:3.0:1789115535.012936:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308277888 00000100:00100000:3.0:1789115535.012975:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789115535.012983:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1164f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308277888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115535.013045:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1164f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308277888:12345-0@lo:400:kworker.0 Request processed in 63us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115535.013051:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789115535.013101:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc1165a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308277888:0@lo:400:kworker.0 00000100:00100000:2.0:1789115535.017423:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115535.017510:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308277760 00000100:00100000:3.0:1789115535.017532:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308277760 00000100:00080000:1.0:1789115535.017590:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115535.017607:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789115535.017619:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308277760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115535.018966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115535.019012:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc1166940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308278144:0@lo:400:kworker.0 00000100:00100000:1.0:1789115535.019056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115535.019120:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308278144 00000100:00100000:1.0:1789115535.019126:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308278144 00000100:00100000:1.0:1789115535.019169:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789115535.019378:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308277632 00000100:00100000:2.0:1789115535.019400:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308277632 00000100:00100000:2.0:1789115535.019429:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789115535.019437:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308277632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115535.019490:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308277632:12345-0@lo:400:kworker.0 Request processed in 54us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115535.019510:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789115535.019679:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc8826d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308278144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115535.019715:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc8826d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308278144:12345-0@lo:400:kworker.0 Request processed in 41us (658us total) trans 0 rc 0/0 00000100:00080000:2.0:1789115535.019750:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789115535.019790:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789115535.019829:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308277632:0@lo:400:kworker.0 00000100:00100000:1.0:1789115535.019839:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1789115535.019845:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1789115535.019862:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc1166940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308278144:0@lo:400:kworker.0 00000100:00100000:0.0:1789115535.019976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115535.020024:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc1166580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308278016:0@lo:400:kworker.0 00000100:00100000:0.0:1789115535.020050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115535.020163:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308277504 00000100:00100000:1.0:1789115535.020169:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308277504 00000100:00100000:1.0:1789115535.020212:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789115535.020220:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308277504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115535.021513:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308277504:12345-0@lo:400:kworker.0 Request processed in 1287us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115535.021524:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789115535.022336:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308278016 00000100:00100000:2.0:1789115535.022344:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308278016 00000100:00100000:2.0:1789115535.022416:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789115535.022426:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2572580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308278016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115535.022940:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcf50e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308277504:0@lo:400:kworker.0 00000100:00080000:0.0:1789115535.023073:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115535.025779:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308277760:12345-0@lo:400:kworker.0 Request processed in 8154us (8352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115535.025792:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789115535.026814:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2572580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308278016:12345-0@lo:400:kworker.0 Request processed in 4384us (6756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115535.026825:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789115535.026963:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc1166580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308278016:0@lo:400:kworker.0 00000100:00100000:0.0:1789115535.028444:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc1166d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308277760:0@lo:400:kworker.0 00010000:00010000:1.0:1789115535.080436:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115535.524201:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789115535.524225:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308278272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115535.524297:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115535.524434:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308278272 00000100:00100000:2.0:1789115535.524443:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308278272 00000100:00100000:2.0:1789115535.524491:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789115535.524502:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1165a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308278272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789115535.524538:0:6700:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115535.524592:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1165a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308278272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115535.524600:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789115535.524947:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308278272:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789115536.100189:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115537.125193:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789115537.802931:0:13254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:32:15 (1789115535) 00000001:00080000:2.0:1789115538.136631:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1789115538.136646:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789115538.136697:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789115538.136709:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789115538.150747:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115538.922877:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115538.922912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115538.922939:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115538.922987:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115538.923012:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115538.923034:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288371584 00000100:00100000:3.0:1789115538.923042:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288371840 00000100:00100000:1.0:1789115538.923045:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288371584 00000100:00100000:3.0:1789115538.923048:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288371840 00000100:00100000:3.0:1789115538.923108:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288371712 00000100:00100000:3.0:1789115538.923111:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288371712 00000100:00100000:1.0:1789115538.923114:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288371968 00000100:00100000:1.0:1789115538.923119:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288371968 00000100:00100000:3.0:1789115538.923141:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:1.0:1789115538.923152:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:3.0:1789115538.923155:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1165680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2350:x1876023288371840:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115538.923164:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+18:2350:x1876023288371584:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115538.923925:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1165680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+7:2350:x1876023288371840:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 770us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115538.923935:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:3.0:1789115538.923968:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:3.0:1789115538.923977:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1166d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2350:x1876023288371712:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115538.925787:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dbf7574-92fb-4b89-af78-41319f924699+18:2350:x1876023288371584:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 2616us (2908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115538.925801:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:1.0:1789115538.925837:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:1.0:1789115538.925849:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1166580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:2350:x1876023288371968:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115538.925895:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1166580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:2350:x1876023288371968:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 51us (2881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115538.925901:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:3.0:1789115538.929303:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1166d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dbf7574-92fb-4b89-af78-41319f924699+5:2350:x1876023288371712:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 5318us (6306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115538.929317:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:3.0:1789115538.929355:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288371456 00000100:00100000:3.0:1789115538.929362:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288371456 00000100:00100000:3.0:1789115538.929430:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 330 00000100:00100000:3.0:1789115538.929439:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288371456:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115538.929479:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288371456:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 41us (6540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115538.929485:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 330 00000100:00080000:3.0:1789115538.929516:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789115538.929521:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789115538.929524:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789115539.112009:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc57383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308278400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789115539.112124:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115539.112220:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308278400 00000100:00100000:2.0:1789115539.112240:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308278400 00000100:00080000:0.0:1789115539.112580:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789115539.112610:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789115539.112627:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1166940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308278400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789115539.112678:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115539.112748:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1166940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308278400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115539.112757:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789115539.112821:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc57383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308278400:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789115539.171980:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115540.131920:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308278528:0@lo:400:kworker.0 00000100:00100000:0.0:1789115540.132021:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc333c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308278656:0@lo:400:kworker.0 00000100:00100000:0.0:1789115540.132073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115540.132125:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115540.132141:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc098b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308279168:0@lo:400:kworker.0 00000100:00100000:1.0:1789115540.132171:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc0992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308279040:0@lo:400:kworker.0 00000100:00100000:0.0:1789115540.132178:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115540.132206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115540.132237:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308278912:0@lo:400:kworker.0 00000100:00100000:1.0:1789115540.132256:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308278528 00000100:00100000:1.0:1789115540.132264:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308278528 00000100:00100000:0.0:1789115540.132276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115540.132302:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789115540.132310:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308278784:0@lo:400:kworker.0 00000100:00100000:1.0:1789115540.132314:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789115540.132326:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308278528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115540.132339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115540.132373:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308279168 00000100:00100000:0.0:1789115540.132378:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308279168 00000100:00100000:1.0:1789115540.132406:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308278528:12345-0@lo:400:kworker.0 Request processed in 82us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115540.132425:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789115540.132444:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308278912 00000100:00100000:0.0:1789115540.132448:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308278912 00000100:00100000:1.0:1789115540.132465:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308278656 00000100:00100000:1.0:1789115540.132471:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308278656 00000100:00100000:0.0:1789115540.132476:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789115540.132487:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308279168:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789115540.132519:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789115540.132529:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308279168:12345-0@lo:400:kworker.0 Request processed in 44us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115540.132534:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308279040 00000100:00100000:0.0:1789115540.132539:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789115540.132540:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308279040 00000100:00100000:0.0:1789115540.132558:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789115540.132567:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc25721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308278912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115540.132578:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308278784 00000100:00100000:2.0:1789115540.132582:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308278784 00000100:00100000:2.0:1789115540.132606:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789115540.132610:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc25721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308278912:12345-0@lo:400:kworker.0 Request processed in 44us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115540.132618:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308279040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115540.132619:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789115540.132625:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789115540.132641:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308278784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115540.132663:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308278912:0@lo:400:kworker.0 00000100:00100000:2.0:1789115540.132678:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308279040:12345-0@lo:400:kworker.0 Request processed in 62us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115540.132687:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789115540.132699:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308278784:12345-0@lo:400:kworker.0 Request processed in 61us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115540.132705:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308278784:0@lo:400:kworker.0 00000100:00100000:2.0:1789115540.132709:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789115540.132719:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2571680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308278656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115540.132750:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2571680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308278656:12345-0@lo:400:kworker.0 Request processed in 32us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115540.132783:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789115540.132817:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc0992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308279040:0@lo:400:kworker.0 00000100:00100000:1.0:1789115540.132826:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308278528:0@lo:400:kworker.0 00000100:00100000:1.0:1789115540.132861:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc333c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308278656:0@lo:400:kworker.0 00000100:00100000:1.0:1789115540.132870:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc098b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308279168:0@lo:400:kworker.0 00000100:00080000:3.0:1789115540.132920:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115540.134862:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00010000:00010000:1.0:1789115540.196188:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115540.643662:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308279296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789115540.643735:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115540.643982:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308279296 00000100:00100000:2.0:1789115540.643990:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308279296 00000100:00100000:2.0:1789115540.644048:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789115540.644058:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2573840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308279296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789115540.644093:0:12414:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115540.644151:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2573840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308279296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115540.644159:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789115540.644308:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308279296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115540.767827:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115540.770344:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288372224 00000100:00100000:2.0:1789115540.770359:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288372224 00000100:00100000:2.0:1789115540.770543:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1789115540.770554:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc099e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+18:12533:x1876023288372224:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:2.0:1789115540.771351:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc099e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+19:12533:x1876023288372224:12345-192.168.203.31@tcp:35:umount.0 Request processed in 794us (3528us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789115540.771359:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1789115540.774670:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00080000:3.0:1789115540.776073:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115540.776617:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288372480 00000100:00100000:1.0:1789115540.776628:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288372480 00000100:00100000:1.0:1789115540.776747:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:1.0:1789115540.776758:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc57383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+19:12533:x1876023288372480:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:1.0:1789115540.777136:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc57383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+20:12533:x1876023288372480:12345-192.168.203.31@tcp:35:umount.0 Request processed in 379us (2472us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789115540.777144:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1789115540.781561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115540.782303:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288372736 00000100:00100000:2.0:1789115540.782313:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288372736 00000100:00100000:2.0:1789115540.782367:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:2.0:1789115540.782375:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc88a5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+20:12533:x1876023288372736:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:2.0:1789115540.785368:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc88a5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dbf7574-92fb-4b89-af78-41319f924699+21:12533:x1876023288372736:12345-192.168.203.31@tcp:35:umount.0 Request processed in 2981us (3861us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789115540.785415:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1789115540.789866:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115540.789941:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288372992 00000100:00100000:1.0:1789115540.789960:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288372992 00000100:00100000:1.0:1789115540.790088:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:1.0:1789115540.790099:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc0983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+21:12533:x1876023288372992:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:1.0:1789115540.790474:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc0983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dbf7574-92fb-4b89-af78-41319f924699+22:12533:x1876023288372992:12345-192.168.203.31@tcp:35:umount.0 Request processed in 375us (616us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789115540.790482:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:0.0:1789115540.794434:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115540.794478:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115540.794524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115540.794603:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288373504 00000100:00100000:1.0:1789115540.794612:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288373504 00000100:00100000:1.0:1789115540.794669:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288373760 00000100:00100000:1.0:1789115540.794672:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288373760 00000100:00100000:1.0:1789115540.794686:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288373632 00000100:00100000:1.0:1789115540.794689:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288373632 00000100:00100000:1.0:1789115540.794704:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1789115540.794713:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc25712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b938f65-f46e-46d5-8ccc-96c5e68593dd+15:2350:x1876023288373504:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115540.794728:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115540.794746:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28fe00/0xa47abda6516d3106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a14 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.794761:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115540.794809:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc25712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b938f65-f46e-46d5-8ccc-96c5e68593dd+14:2350:x1876023288373504:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 97us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115540.794817:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1789115540.794844:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1789115540.794849:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2570b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b938f65-f46e-46d5-8ccc-96c5e68593dd+13:2350:x1876023288373760:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115540.794855:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115540.794861:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d33bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3aed expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.794870:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115540.794888:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2570b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:2350:x1876023288373760:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 39us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115540.794907:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:3.0:1789115540.794920:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2572d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+12:2350:x1876023288373632:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115540.794930:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115540.794943:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcda95da00/0xa47abda6516d30ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa39dc expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115540.794965:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115540.794992:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:3.0:1789115540.794994:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2572d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:2350:x1876023288373632:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 75us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115540.795004:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1789115540.796333:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115540.796509:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288373376 00000100:00100000:1.0:1789115540.796517:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288373376 00000100:00100000:1.0:1789115540.796586:0:6885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:1.0:1789115540.796598:0:6885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2571e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2349:x1876023288373376:12345-192.168.203.31@tcp:9:umount.0 00000100:00080000:3.0:1789115540.796599:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1789115540.796643:0:6885:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d36e0 00000020:00010000:1.0:1789115540.796649:0:6885:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dfce2908000: total 0 00000100:00080000:1.0:1789115540.796654:0:6885:0:(import.c:65:import_set_state_nolock()) ffff8dfcc70ba000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789115540.796687:0:6885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1789115540.796932:0:6885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2571e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dbf7574-92fb-4b89-af78-41319f924699+5:2349:x1876023288373376:12345-192.168.203.31@tcp:9:umount.0 Request processed in 337us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115540.796940:0:6885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000020:00010000:0.0:1789115540.797009:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dfce2908000: total 0 00010000:00010000:0.0:1789115540.797040:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dfce2908000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789115540.797099:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dad810a/0xa47abda6516d4121 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e90 expref: 4 pid: 6885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115540.797133:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003c056a0/0xa47abda6516d3a83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cc2 expref: 3 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115540.797148:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dfce2908000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789115540.797168:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115540.797171:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115540.797172:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115540.803477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115540.803564:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288373888 00000100:00100000:1.0:1789115540.803573:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288373888 00000100:00100000:1.0:1789115540.803642:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:1.0:1789115540.803652:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+5:2349:x1876023288373888:12345-192.168.203.31@tcp:9:umount.0 00000020:00000080:1.0:1789115540.803681:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d347f 00000100:00080000:1.0:1789115540.803689:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8dfcc6044800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789115540.803719:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:1.0:1789115540.803721:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1789115540.804544:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115540.804754:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dbf7574-92fb-4b89-af78-41319f924699+2:2349:x1876023288373888:12345-192.168.203.31@tcp:9:umount.0 Request processed in 1100us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115540.804765:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:2.0:1789115540.813499:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115540.813686:0:8213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288374912 00000100:00100000:1.0:1789115540.813696:0:8213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288374912 00000100:00100000:0.0:1789115540.813849:0:8213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 240 00000100:00100000:0.0:1789115540.813861:0:8213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc57383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+22:2349:x1876023288374912:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:0.0:1789115540.813895:0:8213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d30dc 00000020:00010000:0.0:1789115540.813909:0:8213:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dfcffb00800: total 0 00000100:00080000:0.0:1789115540.813913:0:8213:0:(import.c:65:import_set_state_nolock()) ffff8dfcc4f4a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789115540.813944:0:8213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1789115540.814183:0:7632:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dfcffb00800: total 0 00010000:00010000:1.0:1789115540.814225:0:7632:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dfcffb00800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789115540.814270:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115540.814274:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789115540.814281:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5e00/0xa47abda6516d3de0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3db7 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.814301:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115540.814304:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789115540.814307:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7e00/0xa47abda6516d3742 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3be9 expref: 20 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.814318:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dfcf2157f00) 00010000:00010000:1.0:1789115540.814320:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789115540.814323:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d33e5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3afb expref: 19 pid: 8213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.814342:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dfcd01ae300) 00010000:00010000:1.0:1789115540.814344:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789115540.814347:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7a00/0xa47abda6516d3b01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ce5 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.814360:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:1.0:1789115540.814362:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789115540.814365:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7600/0xa47abda6516d3964 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3c75 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.814375:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dfcd044f100) 00010000:00010000:1.0:1789115540.814377:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789115540.814431:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f200/0xa47abda6516d3455 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b17 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.814468:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:1.0:1789115540.814471:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789115540.814475:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d4002 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e43 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.814489:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:1.0:1789115540.814492:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115540.814496:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7c00/0xa47abda6516d3401 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3b02 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.814518:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:1.0:1789115540.814521:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789115540.814524:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c5400/0xa47abda6516d3a6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cbb expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.814536:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:1.0:1789115540.814538:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115540.814541:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedac7800/0xa47abda6516d40e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e7b expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.814553:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:1.0:1789115540.814555:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789115540.814558:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd021c4c00/0xa47abda6516d3ae5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cde expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.814572:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dfcd044ff00) 00010000:00010000:1.0:1789115540.814574:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789115540.814586:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcedacd200/0xa47abda6516d410c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e89 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.814604:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dfcd044f800) 00010000:00010000:1.0:1789115540.814606:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115540.814610:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f600/0xa47abda6516d3a44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3cad expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115540.814622:0:7632:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dfcffb00800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789115540.814636:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115540.814638:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115540.814640:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115540.815585:0:8213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc57383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dbf7574-92fb-4b89-af78-41319f924699+7:2349:x1876023288374912:12345-192.168.203.31@tcp:39:umount.0 Request processed in 1720us (2088us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789115540.815596:0:8213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 240 00010000:00010000:0.0:1789115541.219541:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115541.980427:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115541.980475:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115541.980546:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288375040 00000100:00100000:0.0:1789115541.980581:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288375040 00000100:00100000:0.0:1789115541.980642:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288375168 00000100:00100000:0.0:1789115541.980645:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288375168 00000100:00100000:0.0:1789115541.980680:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1789115541.980693:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1789115541.980694:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:2352:x1876023288375040:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115541.980711:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115541.980732:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28f800/0xa47abda6516d31ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a29 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115541.980772:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc098f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b938f65-f46e-46d5-8ccc-96c5e68593dd+11:2352:x1876023288375168:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115541.980784:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115541.980798:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc1520c00/0xa47abda6516d31b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a53 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115541.980807:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115541.980854:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:2352:x1876023288375040:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 165us (435us total) trans 0 rc 0/0 00010000:00010000:1.0:1789115541.980858:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115541.980878:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1789115541.980886:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc098f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b938f65-f46e-46d5-8ccc-96c5e68593dd+9:2352:x1876023288375168:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 181us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115541.980895:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1789115541.981445:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115541.981856:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288375296 00000100:00100000:0.0:1789115541.981862:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288375296 00000100:00100000:0.0:1789115541.982096:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:0.0:1789115541.982105:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5738f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+8:2351:x1876023288375296:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115541.982116:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115541.982132:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28e600/0xa47abda6516d33b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ae6 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115541.982144:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115541.982177:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5738f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b938f65-f46e-46d5-8ccc-96c5e68593dd+7:2351:x1876023288375296:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 74us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115541.982184:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1789115541.990732:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115541.990827:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288375552 00000100:00100000:0.0:1789115541.990837:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288375552 00000100:00100000:0.0:1789115541.990909:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:0.0:1789115541.990926:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc099a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+6:2349:x1876023288375552:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:0.0:1789115541.991029:0:5850:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d31c3 00000020:00010000:0.0:1789115541.991038:0:5850:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dfcfbfcf000: total 0 00000100:00080000:0.0:1789115541.991042:0:5850:0:(import.c:65:import_set_state_nolock()) ffff8dfcfbfcd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789115541.991070:0:5850:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:2.0:1789115541.991148:0:5839:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dfcfbfcf000: total 0 00010000:00010000:2.0:1789115541.991153:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115541.991206:0:5839:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dfcfbfcf000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789115541.991244:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd044fb00) 00010000:00010000:2.0:1789115541.991248:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789115541.991257:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d412f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3e97 expref: 5 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115541.991280:0:5839:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dfcfbfcf000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789115541.991291:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115541.991293:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115541.991294:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115541.991342:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc099a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cadbd13-840d-4129-bfc1-7f8a738ff142+3:2349:x1876023288375552:12345-192.168.203.31@tcp:39:umount.0 Request processed in 417us (917us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789115541.991351:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00080000:3.0:1789115541.991671:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115542.014782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115542.016071:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288375808 00000100:00100000:1.0:1789115542.016082:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288375808 00000100:00100000:1.0:1789115542.016150:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 332 00000100:00100000:1.0:1789115542.016161:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf21cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+7:2349:x1876023288375808:12345-192.168.203.31@tcp:251:umount.0 00000020:00000080:1.0:1789115542.016206:0:5846:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d30b9 00000020:00010000:1.0:1789115542.016214:0:5846:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dfcffb07000: total 0 00000100:00080000:1.0:1789115542.016230:0:5846:0:(import.c:65:import_set_state_nolock()) ffff8dfcffb03000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1789115542.016285:0:7632:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dfcffb07000: total 0 00000100:00100000:1.0:1789115542.016309:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf21cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b938f65-f46e-46d5-8ccc-96c5e68593dd+3:2349:x1876023288375808:12345-192.168.203.31@tcp:251:umount.0 Request processed in 149us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115542.016318:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 332 00010000:00010000:3.0:1789115542.016333:0:7632:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dfcffb07000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789115542.016368:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcda95d600/0xa47abda6516d310d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3a1b expref: 2 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115542.016411:0:7632:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dfcffb07000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789115542.016422:0:7632:0:(genops.c:885:class_export_put()) final put ffff8dfcffb07000/7b938f65-f46e-46d5-8ccc-96c5e68593dd 00010000:00010000:3.0:1789115542.016433:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115542.016435:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115542.016437:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789115542.016444:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcffb07000/7b938f65-f46e-46d5-8ccc-96c5e68593dd for MGS 00000020:00000080:3.0:1789115542.016476:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcffb03000 for MGS 00010000:00010000:0.0:1789115542.243531:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789115543.256063:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6dbf7574-92fb-4b89-af78-41319f924699 00000020:00000080:1.0:1789115543.256071:0:7644:0:(genops.c:885:class_export_put()) final put ffff8dfce2908000/6dbf7574-92fb-4b89-af78-41319f924699 00000020:00000080:0.0:1789115543.257279:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfce2908000/6dbf7574-92fb-4b89-af78-41319f924699 for lustre-OST0001 00000020:00000080:2.0:1789115543.257348:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcc70ba000 for lustre-OST0001 00000001:00100000:2.0:1789115543.260969:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5cadbd13-840d-4129-bfc1-7f8a738ff142 00000001:00080000:2.0:1789115543.260985:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789115543.260991:0:5873:0:(genops.c:885:class_export_put()) final put ffff8dfcfbfcf000/5cadbd13-840d-4129-bfc1-7f8a738ff142 00000001:00100000:2.0:1789115543.261009:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6dbf7574-92fb-4b89-af78-41319f924699 00000001:00080000:2.0:1789115543.261015:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1789115543.261041:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcfbfcf000/5cadbd13-840d-4129-bfc1-7f8a738ff142 for lustre-MDT0000 00000020:00000080:1.0:1789115543.261093:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcfbfcd800 for lustre-MDT0000 00000020:00000080:2.0:1789115543.261176:0:5873:0:(genops.c:885:class_export_put()) final put ffff8dfcffb00800/6dbf7574-92fb-4b89-af78-41319f924699 00000020:00000080:1.0:1789115543.261270:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcffb00800/6dbf7574-92fb-4b89-af78-41319f924699 for lustre-MDT0000 00000020:00000080:1.0:1789115543.261357:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcc4f4a000 for lustre-MDT0000 00000020:01000004:2.0:1789115543.265231:0:13453:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:2.0:1789115543.272358:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789115543.278197:0:13453:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789115543.278237:0:13453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115543.278248:0:13453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115543.278253:0:13453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115543.278257:0:13453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115543.278273:0:13453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789115543.278278:0:13453:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1789115543.278294:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1789115543.278299:0:13453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1789115543.278301:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115543.278302:0:13453:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789115543.278307:0:13453:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1789115543.278308:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95d000 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:2.0:1789115543.278312:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.278320:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789115543.278327:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115543.278332:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:3.0:1789115543.278335:0:13453:0:(import.c:65:import_set_state_nolock()) ffff8dfcec596800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:2.0:1789115543.278335:0:7632:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789115543.278337:0:7632:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789115543.278360:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.278367:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789115543.278408:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.278416:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d000/0xa47abda6516d314c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d3153 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.278428:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115543.278430:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115543.278437:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115543.278454:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc098780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876023308279424:0@lo:39:umount.0 00000100:00100000:2.0:1789115543.278515:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115543.278573:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789115543.278582:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308279552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789115543.278610:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115543.278641:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308279424 00000100:00100000:2.0:1789115543.278646:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308279424 00000100:00100000:2.0:1789115543.278686:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789115543.278694:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf51861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876023308279424:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789115543.278715:0:5851:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2ec8 00000100:00080000:2.0:1789115543.278722:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8dfcfcfd0000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789115543.278771:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf51861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1876023308279424:12345-0@lo:39:umount.0 Request processed in 78us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115543.278779:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1789115543.278787:0:5851:0:(genops.c:885:class_export_put()) final put ffff8dfcfcfd3800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1789115543.278809:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308279552 00000100:00100000:2.0:1789115543.278813:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308279552 00000100:00100000:2.0:1789115543.278838:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789115543.278844:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfce293a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3307:x1876023308279552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789115543.278854:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115543.278867:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc1521e00/0xa47abda6516d3153 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d314c expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.278879:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115543.278903:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfce293a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+18:3307:x1876023308279552:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115543.278909:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789115543.278976:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115543.279002:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d846835-79f9-4361-81d5-b56fc2e9378a:3307:1876023308279552:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1789115543.279021:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcfcfd3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789115543.279169:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcfcfd0000 for lustre-MDT0000 00000100:00080000:2.0:1789115543.279195:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcec596800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789115543.279204:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc098780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876023308279424:0@lo:39:umount.0 00000100:00080000:2.0:1789115543.279219:0:13453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789115543.279221:0:13453:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789115543.279224:0:13453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789115543.280200:0:13453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280215:0:13453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280222:0:13453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280228:0:13453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280271:0:13453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789115543.280277:0:13453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280283:0:13453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280289:0:13453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280303:0:13453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115543.280350:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789115543.280356:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115543.280362:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c5000 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:0.0:1789115543.280366:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115543.280373:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789115543.280402:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789115543.280408:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789115543.280416:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789115543.280439:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115543.280453:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789115543.280475:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115543.280482:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfd021c5000/0xa47abda6516d315a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d3161 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115543.280495:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115543.280499:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115543.280508:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1520000 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:0.0:1789115543.280511:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115543.280518:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789115543.280524:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789115543.280530:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789115543.280531:0:13453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:0.0:1789115543.280532:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789115543.280534:0:13453:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789115543.280543:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280544:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115543.280549:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789115543.280553:0:13453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115543.280554:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280560:0:13453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280567:0:13453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115543.280570:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520000/0xa47abda6516d3073 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d307a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280573:0:13453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280583:0:13453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789115543.280583:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115543.280586:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280589:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115543.280591:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ee00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:0.0:1789115543.280594:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280595:0:13453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95de00/0xa47abda6516d2e27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280602:0:13453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95de00/0xa47abda6516d2e27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115543.280602:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280609:0:13453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95de00/0xa47abda6516d2e27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789115543.280609:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789115543.280615:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789115543.280618:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789115543.280620:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789115543.280625:0:13453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8dfcda95de00/0xa47abda6516d2e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115543.280632:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280636:0:13453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789115543.280637:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1789115543.280639:0:13453:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789115543.280642:0:13453:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1789115543.280652:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115543.280655:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc25730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308279680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789115543.280661:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfccf28ee00/0xa47abda6516d33a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d33ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280663:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789115543.280667:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcda95de00/0xa47abda6516d2e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280675:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95de00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:2.0:1789115543.280677:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95de00/0xa47abda6516d2e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115543.280680:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115543.280682:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115543.280684:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115543.280685:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcda95de00/0xa47abda6516d2e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789115543.280691:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95de00/0xa47abda6516d2e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115543.280691:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:01000000:2.0:1789115543.280697:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789115543.280699:0:7632:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789115543.280701:0:7632:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:0.0:1789115543.280703:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2571a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308279936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789115543.280714:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789115543.280717:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcda95de00/0xa47abda6516d2e27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280725:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789115543.280733:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95de00/0xa47abda6516d2e27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115543.280738:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789115543.280749:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcda95de00/0xa47abda6516d2e27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d2e2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280762:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115543.280765:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115543.280765:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789115543.280766:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308280064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789115543.280767:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115543.280777:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2570f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308279808:0@lo:103:ldlm_bl.0 00000020:01000004:2.0:1789115543.280784:0:13453:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789115543.280789:0:13453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000100:00100000:0.0:1789115543.280789:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1789115543.280794:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000100:00100000:2.0:1789115543.280813:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308279680 00000100:00100000:2.0:1789115543.280818:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308279680 00000100:00100000:1.0:1789115543.280824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115543.280825:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308279936 00000100:00100000:0.0:1789115543.280830:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308279936 00000100:00100000:2.0:1789115543.280853:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308279808 00000100:00100000:0.0:1789115543.280853:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308280064 00000100:00100000:2.0:1789115543.280855:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308279808 00000100:00100000:0.0:1789115543.280855:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308280064 00000100:00100000:1.0:1789115543.280876:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789115543.280885:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789115543.280890:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf50e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d846835-79f9-4361-81d5-b56fc2e9378a+21:3305:x1876023308279680:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789115543.280898:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc25712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+21:3308:x1876023308279936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789115543.280903:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115543.280908:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115543.280918:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcda95d800/0xa47abda6516d3161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d315a expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.280922:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d33ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d33a6 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115543.280945:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789115543.280952:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115543.280985:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf50e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3305:x1876023308279680:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115543.280993:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789115543.280998:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc25712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+19:3308:x1876023308279936:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115543.281007:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789115543.281014:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789115543.281024:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc333480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d846835-79f9-4361-81d5-b56fc2e9378a+17:3305:x1876023308279808:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789115543.281029:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789115543.281040:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2570b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+17:3308:x1876023308280064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789115543.281042:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115543.281055:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcda95ca00/0xa47abda6516d307a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d3073 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.281062:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115543.281071:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789115543.281076:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc1521600/0xa47abda6516d2e2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d2e27 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.281095:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115543.281124:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc333480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d846835-79f9-4361-81d5-b56fc2e9378a+15:3305:x1876023308279808:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115543.281133:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789115543.281137:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2570b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d846835-79f9-4361-81d5-b56fc2e9378a+15:3308:x1876023308280064:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115543.281145:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789115543.281182:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308280064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789115543.281190:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2570f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308279808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789115543.281194:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2571a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308279936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789115543.281211:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc25730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308279680:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1789115543.281214:0:13453:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789115543.281221:0:13453:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dfcfbfcc000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789115543.281226:0:13453:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dfcf5310000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789115543.281231:0:13453:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8dfcd92d4ed8) has exports, disconnecting them 00000020:00080000:2.0:1789115543.281235:0:13453:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dfcfbfcc000), last request at 1789115540 00000020:00000080:2.0:1789115543.281241:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d303b 00000100:00080000:2.0:1789115543.281255:0:13453:0:(import.c:65:import_set_state_nolock()) ffff8dfcfbfca000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789115543.281299:0:13453:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dfcfbfcc000): rc 0 00000020:00000080:2.0:1789115543.281302:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcfbfcc000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789115543.281317:0:13453:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dfcf5310000), last request at 1789115540 00000020:00000080:2.0:1789115543.281320:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2f70 00000100:00080000:2.0:1789115543.281325:0:13453:0:(import.c:65:import_set_state_nolock()) ffff8dfcf5317800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789115543.281332:0:13453:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dfcf5310000): rc 0 00000020:00000080:2.0:1789115543.281334:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcf5310000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789115543.281342:0:13453:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaea78389fae0 00000020:00000080:1.0:1789115543.281342:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcfbfcc000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:2.0:1789115543.281362:0:13453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789115543.281365:0:13453:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1789115543.281376:0:13453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1789115543.281431:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcf5310000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789115543.281463:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcfbfca000 for lustre-MDT0000 00000020:00000080:1.0:1789115543.281469:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcf5317800 for lustre-MDT0000 00010000:00010000:0.0:1789115543.281471:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789115543.281481:0:13453:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:0.0:1789115543.281481:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789115543.281499:0:13453:0:(import.c:65:import_set_state_nolock()) ffff8dfcd933a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789115543.281520:0:13453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789115543.281522:0:13453:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000100:00100000:0.0:1789115543.281564:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308280192:0@lo:9:umount.0 00000004:00080000:2.0:1789115543.281576:0:13453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789115543.281595:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789115543.281638:0:13453:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789115543.281649:0:13453:0:(import.c:65:import_set_state_nolock()) ffff8dfbc1365000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789115543.281650:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308280192 00000100:00100000:3.0:1789115543.281655:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308280192 00000020:00080000:2.0:1789115543.281685:0:13453:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8dfcd92d4ed8) has no exports 00000100:00100000:3.0:1789115543.281692:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789115543.281699:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2572d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876023308280192:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789115543.281718:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2fbd 00000100:00080000:3.0:1789115543.281723:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8dfcd933f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789115543.281750:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1789115543.281757:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115543.281890:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2572d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3304:x1876023308280192:12345-0@lo:9:umount.0 Request processed in 191us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115543.281897:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789115543.281911:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789115543.281961:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308280320:0@lo:9:umount.0 00000100:00100000:0.0:1789115543.281987:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115543.282014:0:6885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308280320 00000100:00080000:0.0:1789115543.282014:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcd933a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789115543.282018:0:6885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308280320 00000004:00080000:0.0:1789115543.282022:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789115543.282024:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789115543.282027:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308280192:0@lo:9:umount.0 00000100:00100000:3.0:1789115543.282075:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789115543.282084:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc25703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876023308280320:12345-0@lo:9:umount.0 00000100:00080000:1.0:1789115543.282094:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1789115543.282096:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d30a4 00000100:00080000:3.0:1789115543.282101:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8dfcfbf97800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789115543.282155:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789115543.282359:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc25703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3304:x1876023308280320:12345-0@lo:9:umount.0 Request processed in 275us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115543.282365:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789115543.282549:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfbc1365000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789115543.282562:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789115543.282564:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789115543.282568:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308280320:0@lo:9:umount.0 00010000:00010000:0.0:1789115543.282664:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789115543.292981:0:13453:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8dfcd92d4ed8) has no exports 00000020:00000080:2.0:1789115543.344849:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2e82 00000020:00000080:2.0:1789115543.344866:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcd9757000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789115543.344969:0:13453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789115543.345157:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789115543.345168:0:13453:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789115543.345172:0:13453:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8dfcfcfcb490) has no exports 00000020:00000080:2.0:1789115543.345706:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2e7b 00000020:00000080:2.0:1789115543.345713:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcc4d64000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789115543.345829:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcd9757000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789115543.345935:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcc4d64000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789115543.346004:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789115543.346012:0:13453:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789115543.346016:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcf46bb000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789115543.346018:0:13453:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcf46bb000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789115543.346025:0:13453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1789115543.346132:0:13453:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8dfcd85f3060 - data ffff8dfcfd0ed000/ffff8dfcfbfb2400 00000020:01000000:2.0:1789115543.346260:0:13453:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8dfcc7366ba0 - data ffff8dfcf13585e8/ffff8dfcf46a4800 00000001:00000004:1.0:1789115543.362733:0:13453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1789115543.413149:0:13453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789115543.413157:0:13453:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1789115543.413179:0:13453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789115543.413181:0:13453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789115543.414165:0:6880:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789115543.414172:0:6880:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1789115543.414187:0:6880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789115543.416303:0:13453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789115543.416310:0:13453:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1789115543.416842:0:13453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789115543.416845:0:13453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789115543.418141:0:7934:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789115543.418147:0:7934:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1789115543.418159:0:7934:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789115543.479723:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2e4a 00000020:00000080:2.0:1789115543.479734:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcf5313800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789115543.480577:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2e5f 00000020:00000080:0.0:1789115543.480584:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcf5328000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789115543.480590:0:13453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789115543.480595:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789115543.480603:0:13453:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789115543.480607:0:13453:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8dfcd92d0000) has no exports 00000004:01000000:0.0:1789115543.480894:0:13453:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789115543.480902:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d309d 00000020:00000080:0.0:1789115543.480907:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcffb06800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789115543.480912:0:13453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789115543.480915:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789115543.480921:0:13453:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789115543.480924:0:13453:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8dfcfbfc1a48) has no exports 00000020:00000080:0.0:1789115543.480939:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d3096 00000020:00000080:0.0:1789115543.480944:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcd8bab000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789115543.480992:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcf5313800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789115543.481203:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcf5328000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789115543.482028:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcffb06800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789115543.482038:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcd8bab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789115543.485125:0:13453:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789115543.485134:0:13453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789115543.485138:0:13453:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1789115543.485147:0:13453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789115543.485150:0:13453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789115543.485918:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789115543.485919:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfbc1365000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789115543.485943:0:13453:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789115543.485949:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcfbfc8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789115543.485954:0:13453:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcfbfc8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789115543.485963:0:13453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789115543.486037:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2fb6 00000020:00000080:0.0:1789115543.486045:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfbc1361000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789115543.486067:0:13453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789115543.486081:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789115543.486088:0:13453:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789115543.486092:0:13453:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dfcfcfc8000) has no exports 00000020:00000080:0.0:1789115543.486099:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2faf 00000020:00000080:0.0:1789115543.486104:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcd9338800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789115543.486546:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfbc1361000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789115543.486555:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcd9338800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789115543.487559:0:13453:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789115543.487565:0:13453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789115543.487569:0:13453:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1789115543.487575:0:13453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789115543.487577:0:13453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789115543.487622:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789115543.487631:0:13453:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789115543.487658:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789115543.487661:0:13453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789115543.487665:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcf5316000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789115543.487668:0:13453:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcf5316000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789115543.487673:0:13453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789115543.487762:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcd933a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789115543.487770:0:37:0:(genops.c:885:class_export_put()) final put ffff8dfcffd0d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789115543.487773:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcffd0d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789115543.487850:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789115543.488649:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2e66 00000020:00000080:0.0:1789115543.488658:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcf532e800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789115543.488675:0:13453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789115543.488681:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789115543.488687:0:13453:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789115543.488691:0:13453:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8dfcf5324ed8) has no exports 00000020:00000080:0.0:1789115543.488714:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789115543.488718:0:13453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789115543.488722:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2e6d 00000020:00000080:0.0:1789115543.488726:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcf5329800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789115543.488733:0:13453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dfcc65aa800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789115543.488736:0:13453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dfcc65aa800 3 00000020:01000004:0.0:1789115543.488739:0:13453:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dfcc65aa800 from lustre-MDT0000 00000020:00000080:0.0:1789115543.488756:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789115543.488759:0:13453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789115543.488772:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcf5317000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789115543.488774:0:13453:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcf5317000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789115543.488782:0:13453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789115543.488811:0:13453:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789115543.488814:0:13453:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789115543.488817:0:13453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789115543.488819:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789115543.488822:0:13453:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789115543.488828:0:13453:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dfcc302f000 2d846835-79f9-4361-81d5-b56fc2e9378a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789115543.488832:0:13453:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8dfcd8a79a48) has exports, disconnecting them 00000020:00080000:0.0:1789115543.488836:0:13453:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8dfcc302f000), last request at 1789115309 00000020:00000080:0.0:1789115543.488849:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2e0b 00000020:00010000:0.0:1789115543.488854:0:13453:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dfcc302f000: total 2 00000100:00080000:0.0:1789115543.488858:0:13453:0:(import.c:65:import_set_state_nolock()) ffff8dfcc302b800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1789115543.488864:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcf532e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789115543.488871:0:37:0:(genops.c:885:class_export_put()) final put ffff8dfcf5314800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789115543.488874:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcf5314800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00080000:0.0:1789115543.488876:0:13453:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dfcc302f000): rc 0 00000020:01000000:1.0:1789115543.488879:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00080000:0.0:1789115543.488882:0:13453:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8dfcd8a79a48) has no exports 00000020:00010000:2.0:1789115543.488967:0:5839:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dfcc302f000: total 2 00010000:00010000:2.0:1789115543.489004:0:5839:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dfcc302f000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1789115543.489032:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28e800/0xa47abda6516d311b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d3114 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.489048:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d3129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d3122 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.489059:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d3391 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d338a expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.489069:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d3137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d3130 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.489078:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfd021c5a00/0xa47abda6516d3145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d313e expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.489089:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28f000/0xa47abda6516d339f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d3398 expref: 4 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.489101:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfd021c4800/0xa47abda6516d316f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d3168 expref: 3 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.489116:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc1520600/0xa47abda6516d2f23 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa47abda6516d2f1c expref: 2 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115543.489139:0:5839:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dfcc302f000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1789115543.489162:0:5839:0:(genops.c:885:class_export_put()) final put ffff8dfcc302f000/2d846835-79f9-4361-81d5-b56fc2e9378a 00010000:00010000:2.0:1789115543.489180:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115543.489182:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115543.489188:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789115543.489399:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcf5329800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789115543.489405:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcc302f000/2d846835-79f9-4361-81d5-b56fc2e9378a for MGS 00000020:00000080:1.0:1789115543.489577:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcc302b800 for MGS 00000100:00100000:0.0:1789115543.489619:0:5843:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8dfcc8962400:5843] 0 exiting: rc = 1 00000100:00100000:2.0:1789115543.489772:0:5844:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8dfcc8963600:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1789115543.489900:0:5846:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8dfcd13d9400:5846] 2 exiting: rc = 0 00000100:00100000:0.0:1789115543.489974:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.489981:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.489986:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.489992:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.489997:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490002:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490007:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490012:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490017:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490023:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490028:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490034:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490039:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490044:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490049:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490065:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490070:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490076:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490083:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490088:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490093:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490098:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490103:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490107:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490112:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490118:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490124:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490129:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490135:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490140:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490145:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490150:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490154:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490159:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490163:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490433:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490438:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490443:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490448:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490453:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490458:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490463:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490468:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490474:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490478:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490484:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490488:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490714:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490726:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490733:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490748:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490755:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490762:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490769:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490776:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490783:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490790:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490797:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490804:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490811:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490819:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490826:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490834:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.490842:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1789115543.492485:0:13453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789115543.492493:0:13453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1789115543.493466:0:13453:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8dfcd0753180 - data ffff8dfcfd1f75e8/ffff8dfcee4db800 00000020:01000000:0.0:1789115543.493758:0:13453:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8dfcc5d27720 - data ffff8dfce845da20/ffff8dfcd135e400 00000020:00000080:0.0:1789115543.494832:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2def 00000020:00000080:0.0:1789115543.494841:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfce2b00000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789115543.494856:0:13453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dfcc65aa800 from MGS, refs=2 00000020:01000004:0.0:1789115543.494860:0:13453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dfcc65aa800 2 00000020:01000004:0.0:1789115543.494862:0:13453:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dfcc65aa800 from MGS 00000020:00000080:0.0:1789115543.494882:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789115543.494888:0:13453:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789115543.494891:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcd1a41000/MGS 00000020:00000080:0.0:1789115543.494893:0:13453:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcd1a41000/MGS for MGS 00000020:01000000:0.0:1789115543.494899:0:13453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789115543.494970:0:13453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789115543.494974:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789115543.494980:0:13453:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789115543.494987:0:13453:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8dfcec590000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789115543.494993:0:13453:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8dfcd8a78000) has exports, disconnecting them 00000020:00080000:0.0:1789115543.495008:0:13453:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8dfcec590000), last request at 1789115311 00000020:00000080:0.0:1789115543.495012:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2eba 00000020:00080000:0.0:1789115543.495022:0:13453:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dfcec590000): rc 0 00000020:00000080:0.0:1789115543.495026:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcec590000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789115543.495054:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfce2b00000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789115543.495061:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcec590000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789115543.496724:0:13453:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789115543.496732:0:13453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789115543.496736:0:13453:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789115543.496743:0:13453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789115543.496898:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789115543.496905:0:13453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789115543.496911:0:13453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dfcc65aa800 1 00000020:00000080:1.0:1789115543.496917:0:13453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2de1 00000020:00000080:1.0:1789115543.496924:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcd1a46000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789115543.496939:0:13453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789115543.496944:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789115543.496948:0:13453:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789115543.496951:0:13453:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8dfcd8a44ed8) has no exports 00000020:00000080:2.0:1789115543.497004:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcec596800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789115543.497011:0:38:0:(genops.c:885:class_export_put()) final put ffff8dfcec593000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789115543.497014:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcec593000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789115543.497018:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789115543.497076:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcd1a46000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789115543.532540:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789115543.532555:0:13453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789115543.532562:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfce2811800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789115543.532567:0:13453:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfce2811800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789115543.532578:0:13453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789115543.532949:0:13453:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dfce2814000 00000020:01000000:0.0:1789115543.532969:0:13453:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789115543.532974:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789115543.532980:0:13453:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789115543.532984:0:13453:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8dfcd92d1a48) has no exports 00000100:00100000:0.0:1789115543.533070:0:5850:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8dfcc7309000:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1789115543.533540:0:5851:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8dfcc7308200:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1789115543.533615:0:5852:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8dfcc8831800:5852] 2 exiting: rc = 0 00000100:00100000:2.0:1789115543.533873:0:8213:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8dfcc6706800:8213] 3 exiting: rc = 0 00000100:00100000:0.0:1789115543.533992:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534003:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534013:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534021:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534031:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534041:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534048:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534057:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534064:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534073:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534083:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534092:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534101:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534109:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534118:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534138:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534144:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534159:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534177:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534186:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534196:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534204:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534214:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534223:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534231:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534240:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534248:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534254:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534263:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534272:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534281:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534289:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534299:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534309:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534318:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534327:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534341:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534350:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534363:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534373:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534420:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534431:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534440:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534449:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534458:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534478:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534487:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534496:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534506:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534515:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534535:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534544:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534554:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534563:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534571:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534579:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534587:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534596:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534602:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534607:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534615:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534622:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534628:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.534643:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.540249:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8dfcc8830600:5853] 0 exiting: rc = 1 00000100:00100000:1.0:1789115543.540639:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8dfcd8b5a600:5854] 1 exiting: rc = 0 00000100:00100000:0.0:1789115543.540941:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.540951:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.540957:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.540962:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.540967:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.540973:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.540978:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.540983:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.540989:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.540994:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541000:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541006:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541013:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541018:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541025:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541030:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541036:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541042:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541047:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541052:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541057:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541077:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541083:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541088:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541092:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541098:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541103:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541108:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541112:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541118:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541123:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541127:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541132:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541136:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541141:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541146:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541150:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541155:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541161:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541166:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541170:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541176:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541180:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541185:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541190:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541195:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541200:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541206:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541212:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541218:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541223:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541227:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541231:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541236:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541241:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541246:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541258:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541263:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541267:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541271:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541276:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541280:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541284:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.541289:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.541721:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8dfce07a6000:5855] 0 exiting: rc = 1 00000100:00100000:1.0:1789115543.541806:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8dfce07a6a00:5856] 1 exiting: rc = 0 00000100:00100000:0.0:1789115543.542039:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542045:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542051:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542056:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542061:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542080:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542087:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542092:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542098:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542104:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542109:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542115:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542120:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542126:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542132:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542138:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542143:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542163:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542316:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542323:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542329:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542333:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542339:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542345:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542350:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542356:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542361:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542378:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542555:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542579:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542586:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542592:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542597:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542603:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542609:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542615:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542620:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542633:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542642:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542656:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542668:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542674:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542756:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542764:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542770:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542775:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542848:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542856:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542862:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542868:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542873:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542894:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542900:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542905:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542911:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542916:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542922:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542938:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542946:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542954:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542960:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542967:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542981:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.542994:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.551901:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8dfcc8830e00:5857] 0 exiting: rc = 1 00000100:00100000:0.0:1789115543.552127:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8dfce07a6200:5858] 1 exiting: rc = 0 00000100:00100000:2.0:1789115543.552431:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552440:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552447:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552453:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552458:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552463:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552467:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552472:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552477:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552482:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552487:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552493:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552498:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552503:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552508:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552513:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552518:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552524:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552548:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552554:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552560:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552565:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552570:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552575:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552580:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552588:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552594:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552600:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552607:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552616:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552625:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552634:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552642:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552653:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552663:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552670:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552677:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552684:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552689:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552695:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552702:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552707:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552712:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552722:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552727:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552733:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552738:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552743:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552748:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552754:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552760:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552765:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552770:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552834:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552839:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552844:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552849:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552855:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552860:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552865:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552869:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552874:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552880:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.552885:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.557788:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8dfcc5dc0e00:5859] 0 exiting: rc = 1 00000100:00100000:1.0:1789115543.558369:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8dfcc5dc0400:5860] 1 exiting: rc = 0 00000100:00100000:3.0:1789115543.558546:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558554:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558572:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558577:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558582:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558587:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558592:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558597:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558603:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558609:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558613:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558618:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558623:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558629:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558634:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558639:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558644:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558650:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558657:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558663:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558671:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558681:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558688:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558692:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558697:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558702:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558707:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558712:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558717:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558722:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558727:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558732:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558737:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558742:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558747:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558752:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558756:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558767:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558772:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558777:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558782:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558787:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558792:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558797:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558802:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.558807:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559120:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559130:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559135:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559141:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559146:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559151:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559157:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559162:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559167:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559171:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559176:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559181:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559186:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559191:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559196:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559201:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559207:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559212:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789115543.559597:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8dfcc8839200:5862] 1 exiting: rc = 0 00000100:00100000:1.0:1789115543.559673:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8dfcc5dc0800:5861] 0 exiting: rc = 1 00000100:00100000:3.0:1789115543.559880:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559885:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559888:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559892:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559896:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559899:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559902:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559905:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559915:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559918:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559922:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559925:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559946:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559954:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559959:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559965:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559970:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559975:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559979:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559983:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559988:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559993:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.559998:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560003:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560008:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560013:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560019:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560024:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560029:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560034:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560039:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560044:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560049:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560055:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560063:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560068:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560073:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560078:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560083:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560088:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560093:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560098:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560103:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560115:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560120:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560125:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560130:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560135:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560140:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560146:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560151:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560156:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560162:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560167:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560171:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560176:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560180:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560186:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560191:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560196:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560201:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560206:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560211:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115543.560216:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.562203:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8dfcc5d92000:5865] 2 exiting: rc = 0 00000100:00100000:0.0:1789115543.563305:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8dfcc5d92c00:5864] 1 exiting: rc = 0 00000100:00100000:1.0:1789115543.563322:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8dfcc5d92600:5863] 0 exiting: rc = 1 00000100:00100000:2.0:1789115543.563517:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563525:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563531:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563537:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563543:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563548:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563554:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563560:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563566:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563572:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563579:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563584:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563589:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563595:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563601:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563607:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563614:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563620:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563627:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563632:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563638:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563644:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563650:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563669:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563688:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563695:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563701:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563707:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563713:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563718:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563725:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563731:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563737:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563742:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563748:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563754:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563760:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563765:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563771:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563777:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563783:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563789:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563795:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563800:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563806:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563812:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563817:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563822:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563841:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563848:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563853:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563859:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563864:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563870:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563876:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563882:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563887:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563893:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563905:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563910:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563916:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563922:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563941:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115543.563947:0:13453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789115543.569948:0:13453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789115543.569968:0:13453:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789115543.569974:0:13453:0:(genops.c:885:class_export_put()) final put ffff8dfcc836d800/MDS_uuid 00000020:00000080:3.0:1789115543.569979:0:13453:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcc836d800/MDS_uuid for MDS 00000020:01000000:3.0:1789115543.569989:0:13453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789115543.570116:0:13453:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789115544.292563:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789115544.777018:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6dbf7574-92fb-4b89-af78-41319f924699 00000020:00000080:2.0:1789115544.777027:0:6724:0:(genops.c:885:class_export_put()) final put ffff8dfcc6040800/6dbf7574-92fb-4b89-af78-41319f924699 00000001:00100000:2.0:1789115544.777056:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789115544.777059:0:6724:0:(genops.c:885:class_export_put()) final put ffff8dfcd9338000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789115544.777125:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcc6040800/6dbf7574-92fb-4b89-af78-41319f924699 for lustre-OST0000 00000020:00000080:0.0:1789115544.777176:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcd9338000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789115544.777196:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcc6044800 for lustre-OST0000 00000020:00000080:0.0:1789115544.777199:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcd933f000 for lustre-OST0000 00000100:00100000:0.0:1789115545.263138:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308280448:0@lo:400:kworker.0 00000400:00000100:0.0:1789115545.263190:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876023308280448 offset 0 length 224: 4 00000100:00100000:0.0:1789115545.263241:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789115545.263247:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2572580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308280576:0@lo:400:kworker.0 00000400:00000100:0.0:1789115545.263268:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876023308280576 offset 0 length 224: 4 00000100:00100000:0.0:1789115545.263289:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876023308280704:0@lo:400:kworker.0 00000400:00000100:0.0:1789115545.263305:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876023308280704 offset 0 length 224: 4 00010000:00010000:0.0:1789115545.315850:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789115545.877759:0:13605:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789115545.896826:0:13605:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789115545.896872:0:13605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115545.896885:0:13605:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115545.896892:0:13605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115545.896898:0:13605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115545.897497:0:13605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789115545.897504:0:13605:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789115545.897531:0:13605:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789115545.897542:0:13605:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dfbc2572580 x1876023308280576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115561 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115545.897563:0:13605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789115545.897569:0:13605:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789115545.897592:0:13605:0:(import.c:65:import_set_state_nolock()) ffff8dfcffd09800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789115545.898120:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2572580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308280576:0@lo:400:kworker.0 00000100:00100000:3.0:1789115545.898167:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc333c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876023308280832:0@lo:39:umount.0 00000400:00000100:3.0:1789115545.898213:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876023308280832 offset 0 length 224: 4 00010000:00010000:2.0:1789115545.898318:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789115545.898328:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115545.898336:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd021c4e00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:2.0:1789115545.898340:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115545.898349:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789115545.898356:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115545.898362:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789115545.898364:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789115545.898367:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789115545.898629:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115545.898654:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789115545.898713:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308280960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789115545.898752:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115545.898905:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308280960 00000100:00100000:1.0:1789115545.898924:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308280960 00000100:00100000:1.0:1789115545.898963:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789115545.898970:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1876023308280960:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789115545.898976:0:5835:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789115545 with bad export cookie 11851993891407212043 00010000:00010000:3.0:1789115545.899337:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115545.899347:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4e00/0xa47abda6516d3130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa47abda6516d3137 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115545.899363:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115545.899365:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115545.899368:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115545.910517:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1876023308280960:12345-0@lo:103:ldlm_bl.0 Request processed in 11540us (11758us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789115545.910543:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789115545.912452:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789115545.912458:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8dfce2b07000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789115545.912479:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789115545.930236:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.131@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789115545.930243:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789115545.930254:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dfbc2570780 x1876023308280448/t0(0) o400->MGC192.168.203.131@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789115561 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115545.930281:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dfcfc09bc00 x1876023308280960/t0(0) o103->MGC192.168.203.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789115561 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115545.930348:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d846835-79f9-4361-81d5-b56fc2e9378a:3305:1876023308280448:0@lo:400:kworker.0 10000000:01000000:2.0:1789115545.930431:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789115545.930436:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789115545.930438:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789115545.930442:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8dfce2b07000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789115545.930449:0:3308:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 127 00000100:00080000:2.0:1789115545.930459:0:3308:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff8dfce2b07000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1789115545.930590:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfcc573bc00 x1876023308281088/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789115545.930629:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2d846835-79f9-4361-81d5-b56fc2e9378a:3304:1876023308281088:0@lo:250:ptlrpcd_00_03.0 00000100:00100000:2.0:1789115545.930639:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d846835-79f9-4361-81d5-b56fc2e9378a:3308:1876023308280960:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1789115545.930679:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876023308281088 offset 0 length 520: 4 00010000:00010000:1.0:1789115546.342174:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115547.363574:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115548.387703:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789115548.389484:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789115548.389494:0:7644:0:(genops.c:885:class_export_put()) final put ffff8dfcfbf90000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789115548.389589:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcfbf90000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789115548.389656:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcfbf97800 for lustre-OST0001 00010000:00010000:1.0:1789115549.411684:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789115550.374308:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2d846835-79f9-4361-81d5-b56fc2e9378a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789115550.374318:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2d846835-79f9-4361-81d5-b56fc2e9378a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789115550.374692:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308281216:0@lo:400:kworker.0 00000400:00000100:3.0:1789115550.374750:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876023308281216 offset 0 length 224: 4 00010000:00010000:0.0:1789115550.435539:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789115551.400100:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2d846835-79f9-4361-81d5-b56fc2e9378a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789115551.400110:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2d846835-79f9-4361-81d5-b56fc2e9378a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789115551.400237:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789115551.400256:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308281344:0@lo:400:kworker.0 00000400:00000100:2.0:1789115551.400325:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876023308281344 offset 0 length 224: 4 00010000:00010000:1.0:1789115551.459608:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115552.483781:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115553.507524:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115554.531735:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115555.491472:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789115545/real 1789115545] req@ffff8dfcc573bc00 x1876023308281088/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789115555 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115555.491503:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dfcc573bc00 x1876023308281088/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789115555 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115555.491514:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789115545/real 1789115545] req@ffff8dfcfc333c00 x1876023308280832/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789115555 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115555.491546:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dfcfc333c00 x1876023308280832/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789115555 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789115555.491563:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfce2b07000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789115555.491582:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789115555.491586:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2d846835-79f9-4361-81d5-b56fc2e9378a:3304:1876023308281088:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1789115555.491592:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcffd09800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789115555.491605:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc333c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876023308280832:0@lo:39:umount.0 00000100:00080000:0.0:1789115555.491691:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2d846835-79f9-4361-81d5-b56fc2e9378a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789115555.491696:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789115555.491699:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dfce2b07000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789115555.491705:0:38:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 363 00000100:00080000:0.0:1789115555.491709:0:38:0:(import.c:589:import_select_connection()) MGC192.168.203.131@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789115555.491715:0:38:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff8dfce2b07000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1789115555.491742:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfbc2571680 x1876023308281472/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789115555.491855:0:13605:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789115555.491859:0:13605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789115555.491864:0:13605:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1789115555.491880:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789115555.491902:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2573c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876023308281600:0@lo:400:kworker.0 00000400:00000100:2.0:1789115555.491945:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876023308281600 offset 0 length 224: 4 00000100:00100000:2.0:1789115555.492003:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2d846835-79f9-4361-81d5-b56fc2e9378a:3304:1876023308281472:0@lo:250:kworker.0 00000400:00000100:2.0:1789115555.492018:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876023308281472 offset 0 length 520: 4 00010000:00010000:1.0:1789115555.493149:0:13605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3145 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115555.493165:0:13605:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3145 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115555.493173:0:13605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d3145 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115555.493179:0:13605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d3145 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115555.493218:0:13605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789115555.493226:0:13605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d339f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115555.493233:0:13605:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d339f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115555.493239:0:13605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d339f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115555.493245:0:13605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d339f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115555.493260:0:13605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789115555.493346:0:13605:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789115555.493368:0:13605:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789115555.493373:0:13605:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789115555.493379:0:13605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789115555.493403:0:13605:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789115555.493408:0:13605:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8dfcd8a41a48) has no exports 00010000:00010000:2.0:1789115555.493587:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:1.0:1789115555.493594:0:13605:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8dfcd8a41a48) has no exports 00010000:00010000:2.0:1789115555.493595:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d3145 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115555.493603:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95c400 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:2.0:1789115555.493606:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d3145 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115555.493667:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa47abda6516d3145 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789115555.493677:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa47abda6516d3145 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115555.493690:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789115555.493693:0:7632:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1789115555.493695:0:7632:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1789115555.493708:0:7632:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dfce2b07000 00010000:00010000:2.0:1789115555.493712:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa47abda6516d3145 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115555.493719:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c400/0xa47abda6516d313e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa47abda6516d3145 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115555.493732:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789115555.493735:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d339f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115555.493741:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6600 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:2.0:1789115555.493744:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d339f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115555.493751:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa47abda6516d339f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789115555.493757:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa47abda6516d339f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115555.493761:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789115555.493763:0:7632:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789115555.493765:0:7632:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789115555.493768:0:7632:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dfce2b07000 00010000:00010000:2.0:1789115555.493771:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa47abda6516d339f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115555.493782:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d3398 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa47abda6516d339f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115555.493792:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115555.493794:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115555.493796:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115555.495914:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789115555.496567:0:13605:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8dfcd06a40c0 - data ffff8dfcfd0ec510/ffff8dfcf52c3000 00000020:01000000:1.0:1789115555.496813:0:13605:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8dfcc6030ea0 - data ffff8dfbc1527288/ffff8dfcffd07400 00100000:10000000:1.0:1789115555.508219:0:13605:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00010000:00010000:1.0:1789115555.556841:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789115555.571559:0:13605:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2f3f 00000020:00000080:0.0:1789115555.571570:0:13605:0:(genops.c:885:class_export_put()) final put ffff8dfcffb2f800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789115555.571587:0:13605:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dfcd8ba8800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789115555.571591:0:13605:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dfcd8ba8800 2 00000020:01000004:0.0:1789115555.571594:0:13605:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dfcd8ba8800 from lustre-OST0000 00000020:00000080:0.0:1789115555.571623:0:13605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789115555.571632:0:13605:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789115555.571635:0:13605:0:(genops.c:885:class_export_put()) final put ffff8dfcffb2d800/lustre-OST0000_UUID 00000020:00000080:0.0:1789115555.571638:0:13605:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcffb2d800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789115555.571644:0:13605:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789115555.571685:0:13605:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789115555.571690:0:13605:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789115555.571694:0:13605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789115555.571698:0:13605:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789115555.571705:0:13605:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8dfcffd08000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789115555.571710:0:13605:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8dfcfcfc9a48) has exports, disconnecting them 00000020:00080000:0.0:1789115555.571715:0:13605:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8dfcffd08000), last request at 1789115330 00000020:00000080:0.0:1789115555.571719:0:13605:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2f69 00000020:00080000:0.0:1789115555.571729:0:13605:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dfcffd08000): rc 0 00000020:00000080:0.0:1789115555.571733:0:13605:0:(genops.c:885:class_export_put()) final put ffff8dfcffd08000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789115555.574796:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcffb2f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789115555.574821:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcffd08000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789115555.576048:0:13605:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789115555.576070:0:13605:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789115555.576074:0:13605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789115555.576080:0:13605:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789115555.576283:0:13605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789115555.576292:0:13605:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1789115555.576299:0:13605:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dfcd8ba8800 1 00000020:00000080:1.0:1789115555.576305:0:13605:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2ef9 00000020:00000080:1.0:1789115555.576313:0:13605:0:(genops.c:885:class_export_put()) final put ffff8dfcd13a3800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789115555.576319:0:13605:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789115555.576324:0:13605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789115555.576328:0:13605:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789115555.576331:0:13605:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8dfcd8a7ced8) has no exports 00000020:00000080:3.0:1789115555.576746:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcffd09800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789115555.576754:0:38:0:(genops.c:885:class_export_put()) final put ffff8dfcd933c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789115555.576757:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcd933c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789115555.576763:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789115555.576814:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcd13a3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789115555.605595:0:13605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789115555.605612:0:13605:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789115555.605618:0:13605:0:(genops.c:885:class_export_put()) final put ffff8dfcd8ba8000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789115555.605623:0:13605:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcd8ba8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789115555.605714:0:13605:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789115555.605842:0:13605:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dfcd8bab800 00000020:02000400:1.0:1789115555.606456:0:13605:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789115556.581036:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115557.604548:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789115558.178286:0:13760:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789115558.197476:0:13760:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789115558.197735:0:13760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d311b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115558.197754:0:13760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d311b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115558.197762:0:13760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d311b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115558.197769:0:13760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d311b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115558.197840:0:13760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789115558.197848:0:13760:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789115558.197886:0:13760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789115558.197899:0:13760:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dfbc2573480 x1876023308280704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115561 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115558.197926:0:13760:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dfcfc3330c0 x1876023308281216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115566 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115558.197942:0:13760:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dfcfc3303c0 x1876023308281344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115567 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115558.197969:0:13760:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dfbc2573c00 x1876023308281600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115571 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115558.197990:0:13760:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1789115558.198031:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308281344:0@lo:400:kworker.0 00000100:00100000:2.0:1789115558.198042:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308281216:0@lo:400:kworker.0 00000100:00080000:2.0:1789115558.198149:0:13760:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789115558.198179:0:13760:0:(import.c:65:import_set_state_nolock()) ffff8dfcfbfcb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789115558.198212:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876023308281728:0@lo:39:umount.0 00000400:00000100:2.0:1789115558.198274:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876023308281728 offset 0 length 224: 4 00000100:00100000:0.0:1789115558.198530:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876023308280704:0@lo:400:kworker.0 00000100:00100000:1.0:1789115558.200656:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2573c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876023308281600:0@lo:400:kworker.0 00010000:00010000:3.0:1789115558.202915:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115558.202932:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d311b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115558.202971:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95c200 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115558.202976:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d311b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115558.202988:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa47abda6516d311b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115558.202996:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa47abda6516d311b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115558.203002:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789115558.203004:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789115558.203009:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789115558.203030:0:5839:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dfce2b07000 00010000:00010000:3.0:1789115558.203035:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa47abda6516d311b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115558.203162:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcda95c200/0xa47abda6516d3114 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa47abda6516d311b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115558.203178:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115558.203180:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115558.203182:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115558.629290:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115559.655496:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789115560.612565:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2d846835-79f9-4361-81d5-b56fc2e9378a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789115560.612594:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2d846835-79f9-4361-81d5-b56fc2e9378a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789115560.675683:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115561.699714:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115562.725697:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115563.748109:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115564.775696:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789115565.731659:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2d846835-79f9-4361-81d5-b56fc2e9378a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789115565.731669:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2d846835-79f9-4361-81d5-b56fc2e9378a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789115565.795700:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115566.821877:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115567.844146:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115568.420019:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789115558/real 1789115558] req@ffff8dfcc573bc00 x1876023308281728/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789115568 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115568.420068:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dfcc573bc00 x1876023308281728/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789115568 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789115568.420086:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcfbfcb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789115568.420108:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876023308281728:0@lo:39:umount.0 00000100:00080000:0.0:1789115568.422556:0:13760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789115568.422572:0:13760:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789115568.422584:0:13760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789115568.423856:0:13760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3129 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115568.423878:0:13760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3129 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115568.423906:0:13760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d3129 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115568.423912:0:13760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d3129 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115568.423946:0:13760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789115568.423954:0:13760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d3391 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115568.423960:0:13760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d3391 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115568.423966:0:13760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d3391 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115568.423972:0:13760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa47abda6516d3391 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115568.423994:0:13760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789115568.423999:0:13760:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789115568.424028:0:13760:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789115568.424034:0:13760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789115568.424040:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789115568.424046:0:13760:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789115568.424051:0:13760:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dfcfcfcced8) has no exports 00010000:00010000:3.0:1789115568.424951:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789115568.424967:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d3129 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115568.424981:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcda95d400 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115568.424985:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d3129 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115568.424997:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa47abda6516d3129 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115568.425006:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa47abda6516d3129 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115568.425012:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789115568.425015:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789115568.425020:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789115568.425046:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dfce2b07000 00010000:00010000:3.0:1789115568.425050:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa47abda6516d3129 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115568.425058:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcda95d400/0xa47abda6516d3122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa47abda6516d3129 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115568.425082:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115568.425088:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d3391 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115568.425095:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacd800 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115568.425099:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa47abda6516d3391 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115568.425133:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa47abda6516d3391 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115568.425141:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa47abda6516d3391 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115568.425147:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789115568.425150:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789115568.425152:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789115568.425159:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dfce2b07000 00010000:00010000:3.0:1789115568.425162:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa47abda6516d3391 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115568.425168:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcedacd800/0xa47abda6516d338a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa47abda6516d3391 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115568.425182:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115568.425184:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115568.425186:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789115568.427341:0:13760:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dfcfcfcced8) has no exports 00010000:00010000:1.0:1789115568.427929:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789115568.433826:0:13760:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8dfcd06a4b40 - data ffff8dfcfd0355e8/ffff8dfcfbfbec00 00000020:01000000:0.0:1789115568.434043:0:13760:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8dfcffaaac60 - data ffff8dfcfd047e58/ffff8dfcfc3fd800 00100000:10000000:0.0:1789115568.445528:0:13760:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789115568.551276:0:13760:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d300a 00000020:00000080:2.0:1789115568.551291:0:13760:0:(genops.c:885:class_export_put()) final put ffff8dfcc5ded800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789115568.551342:0:13760:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dfcff92b000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789115568.551347:0:13760:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dfcff92b000 2 00000020:01000004:2.0:1789115568.551352:0:13760:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dfcff92b000 from lustre-OST0001 00000020:00000080:2.0:1789115568.551423:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789115568.551713:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcc5ded800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789115568.551771:0:13760:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789115568.551777:0:13760:0:(genops.c:885:class_export_put()) final put ffff8dfcc5de9000/lustre-OST0001_UUID 00000020:00000080:2.0:1789115568.551780:0:13760:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcc5de9000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789115568.551789:0:13760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789115568.551981:0:13760:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2d846835-79f9-4361-81d5-b56fc2e9378a->MGS 00010000:00010000:2.0:1789115568.552789:0:13760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4200/0xa47abda6516d2f1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa47abda6516d2f23 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789115568.552809:0:13760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4200/0xa47abda6516d2f1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa47abda6516d2f23 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115568.552816:0:13760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789115568.552819:0:13760:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789115568.552824:0:13760:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789115568.552846:0:13760:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dfce2b07000 00010000:00010000:2.0:1789115568.552850:0:13760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfd021c4200/0xa47abda6516d2f1c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa47abda6516d2f23 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115568.552871:0:13760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa47abda6516d316f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789115568.552878:0:13760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa47abda6516d316f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115568.552884:0:13760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789115568.552887:0:13760:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789115568.552888:0:13760:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789115568.552900:0:13760:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dfce2b07000 00010000:00010000:2.0:1789115568.552918:0:13760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521400/0xa47abda6516d3168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa47abda6516d316f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789115568.552942:0:13760:0:(import.c:65:import_set_state_nolock()) ffff8dfce2b07000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789115568.552947:0:13760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789115568.552950:0:13760:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789115568.552952:0:13760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789115568.552957:0:13760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789115568.552971:0:13760:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dfbc2571680 x1876023308281472/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789115570 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789115568.553038:0:13760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789115568.553042:0:13760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1789115568.561122:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2d846835-79f9-4361-81d5-b56fc2e9378a:3304:1876023308281472:0@lo:250:kworker.0 10000000:01000000:0.0:1789115568.565119:0:13760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789115568.565146:0:13760:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2dfd 00000020:00000080:0.0:1789115568.565229:0:13760:0:(genops.c:885:class_export_put()) final put ffff8dfcc569a000/2d846835-79f9-4361-81d5-b56fc2e9378a 00000020:01000000:0.0:1789115568.565818:0:13760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.131@tcp (flags='') 00000020:00000080:0.0:1789115568.565831:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789115568.565840:0:13760:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.131@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789115568.565846:0:13760:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8dfcd92d3490) has no exports 10000000:01000000:3.0:1789115568.565938:0:5848:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789115568.566068:0:13760:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.131@tcp: client import never connected 00000100:00080000:0.0:1789115568.566073:0:13760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789115568.566078:0:13760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789115568.566082:0:13760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789115568.566085:0:13760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789115568.568904:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcc569a000/2d846835-79f9-4361-81d5-b56fc2e9378a for MGC192.168.203.131@tcp 00000020:00000080:0.0:1789115568.570248:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789115568.570268:0:13760:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.131@tcp (uuid 2d846835-79f9-4361-81d5-b56fc2e9378a) 00000020:01000000:0.0:1789115568.570278:0:13760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789115568.570287:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789115568.570293:0:13760:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789115568.570303:0:13760:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8dfcfbfc9000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789115568.570310:0:13760:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8dfcfbfc3490) has exports, disconnecting them 00000020:00080000:0.0:1789115568.570316:0:13760:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8dfcfbfc9000), last request at 1789115350 00000020:00000080:0.0:1789115568.570321:0:13760:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d3034 00000020:00080000:0.0:1789115568.570341:0:13760:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dfcfbfc9000): rc 0 00000020:00000080:0.0:1789115568.570347:0:13760:0:(genops.c:885:class_export_put()) final put ffff8dfcfbfc9000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789115568.570703:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfce2b07000 for MGC192.168.203.131@tcp 00000020:00000080:2.0:1789115568.570716:0:38:0:(genops.c:885:class_export_put()) final put ffff8dfcc569e000/2d846835-79f9-4361-81d5-b56fc2e9378a 00000020:00000080:2.0:1789115568.570719:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcc569e000/2d846835-79f9-4361-81d5-b56fc2e9378a for MGC192.168.203.131@tcp 00000020:01000000:2.0:1789115568.570728:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.131@tcp (2d846835-79f9-4361-81d5-b56fc2e9378a) 00000020:00000080:2.0:1789115568.571800:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcfbfc9000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789115568.572800:0:13760:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789115568.572815:0:13760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789115568.572820:0:13760:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789115568.572870:0:13760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789115568.572999:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1789115568.573641:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dfcfbfcb800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1789115568.574786:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1789115568.575123:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789115568.575593:0:5834:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8dfcd126ac00:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1789115568.575766:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8dfcd1286c00:5833] 0 exiting: rc = 1 00000100:00100000:2.0:1789115568.575861:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.576339:0:6713:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8dfcffa6de00:6713] 3 exiting: rc = 0 00000100:00100000:2.0:1789115568.576425:0:5837:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8dfcc70cf400:5837] 2 exiting: rc = 0 00000100:00100000:3.0:1789115568.576715:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8dfcc70cfc00:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1789115568.577724:0:5835:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8dfcc70ce800:5835] 0 exiting: rc = 1 00000100:00100000:2.0:1789115568.577831:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577842:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577849:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577856:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577864:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577871:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577879:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577886:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577893:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577915:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577921:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577927:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577935:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577949:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577960:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.577996:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578003:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578026:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578033:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578040:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578046:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578055:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578065:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578072:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578080:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578086:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578092:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578097:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578103:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578110:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578115:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578121:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578127:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578135:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578145:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578218:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578225:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578230:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578236:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578314:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578320:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578329:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578334:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578340:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578353:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578358:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578364:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578369:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578374:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578379:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578416:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578421:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578598:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578607:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578612:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578617:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578622:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578628:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578633:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578639:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578644:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578649:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578654:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.578659:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789115568.580246:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789115568.580261:0:13760:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789115568.580270:0:13760:0:(genops.c:885:class_export_put()) final put ffff8dfbc1362000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789115568.580275:0:13760:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfbc1362000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789115568.580282:0:13760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1789115568.580419:0:13760:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dfcff92b000 1 00000020:00000080:2.0:1789115568.580668:0:13760:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa47abda6516d2fd9 00000020:00000080:2.0:1789115568.580677:0:13760:0:(genops.c:885:class_export_put()) final put ffff8dfcff92c800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789115568.580699:0:13760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789115568.580707:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789115568.580711:0:13760:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789115568.580746:0:13760:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8dfcd8a7b490) has no exports 00000020:00000080:3.0:1789115568.580787:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcff92c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789115568.600822:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789115568.600910:0:13760:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789115568.600918:0:13760:0:(genops.c:885:class_export_put()) final put ffff8dfcff92b800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789115568.600924:0:13760:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcff92b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789115568.600959:0:13760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789115568.601714:0:13760:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dfcff928800 00000020:01000000:3.0:1789115568.601749:0:13760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789115568.601754:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789115568.601769:0:13760:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789115568.601774:0:13760:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8dfcd8a43490) has no exports 00000020:00000080:3.0:1789115568.601811:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789115568.601820:0:13760:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789115568.601823:0:13760:0:(genops.c:885:class_export_put()) final put ffff8dfcd13a2800/OSS_uuid 00000020:00000080:3.0:1789115568.601826:0:13760:0:(genops.c:844:class_export_destroy()) destroying export ffff8dfcd13a2800/OSS_uuid for OSS 00000020:01000000:3.0:1789115568.602162:0:13760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789115568.602263:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8dfcd06c9200:6698] 1 exiting: rc = 0 00000100:00100000:3.0:1789115568.602377:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8dfcedb3ee00:6699] 2 exiting: rc = 0 00000100:00080000:1.0:1789115568.602734:0:5847:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789115568.603104:0:6885:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8dfcf4c3be00:6885] 3 exiting: rc = 0 00000100:00100000:3.0:1789115568.605458:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8dfcd8a2ae00:6697] 0 exiting: rc = 1 00000100:00100000:2.0:1789115568.609213:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610010:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610038:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610052:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610057:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610063:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610069:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610073:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610080:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610086:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610092:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610097:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610103:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610108:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610114:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610119:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610124:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610130:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610136:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610141:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610146:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610152:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610158:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610164:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610169:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610175:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610180:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610185:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610191:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610197:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610203:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610209:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610215:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610222:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610230:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610247:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610254:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610268:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610273:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610280:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610288:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610294:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610301:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610307:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610312:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610317:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610327:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610334:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610340:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610348:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610354:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610360:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610366:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610372:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610377:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610403:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610409:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610415:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610420:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610426:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610431:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610438:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610444:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.610451:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.613372:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8dfcd06c9a00:6700] 0 exiting: rc = 1 00000100:00100000:3.0:1789115568.613526:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8dfcf4e08800:6701] 1 exiting: rc = 0 00000100:00100000:2.0:1789115568.613639:0:12414:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8dfcc31aec00:12414] 2 exiting: rc = 0 00000100:00100000:2.0:1789115568.613720:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613731:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613737:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613744:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613750:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613756:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613774:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613799:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613805:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613812:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613818:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613824:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613831:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613839:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613845:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613851:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613857:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613863:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613869:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613876:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613882:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613888:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613894:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613900:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613905:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613911:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613918:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613924:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613931:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613939:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613946:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613953:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613959:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613966:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613972:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613978:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613984:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613990:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.613996:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614002:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614008:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614013:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614027:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614033:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614040:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614049:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614055:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614061:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614126:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614132:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614138:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614145:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614327:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614336:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614341:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614347:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614352:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614357:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614362:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614368:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614374:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614452:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614460:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.614466:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.616805:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8dfcedb3fa00:6704] 2 exiting: rc = 0 00000100:00100000:3.0:1789115568.616977:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8dfcedb3e800:6702] 0 exiting: rc = 1 00000100:00100000:2.0:1789115568.619123:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8dfcedb3f800:6703] 1 exiting: rc = 0 00000100:00100000:3.0:1789115568.619552:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619562:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619570:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619577:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619583:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619590:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619611:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619622:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619628:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619635:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619641:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619646:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619653:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619658:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619664:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619670:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619698:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619706:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619713:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619720:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619725:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619731:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619737:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619743:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619749:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619754:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619772:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619779:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619785:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619791:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619798:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619820:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619828:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619834:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619840:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619847:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619854:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619860:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619866:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619872:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619878:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619884:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619891:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619898:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619904:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619910:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619917:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619923:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619928:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619934:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619939:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619954:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619960:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619967:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619974:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619980:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.619997:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.620005:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.620012:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.620018:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.620024:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.620030:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.620037:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.620043:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789115568.627695:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8dfcf4e08a00:6705] 0 exiting: rc = 1 00000100:00100000:1.0:1789115568.628301:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8dfceeda9600:6706] 1 exiting: rc = 0 00000100:00100000:3.0:1789115568.628371:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628398:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628406:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628417:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628424:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628430:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628438:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628443:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628449:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628454:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628460:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628465:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628470:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628476:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628482:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628487:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628492:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628497:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628502:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628507:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628518:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628527:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628549:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628554:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628559:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628564:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628569:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628574:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628578:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628583:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628588:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628593:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628597:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628602:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628607:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628612:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628617:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628622:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628626:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628631:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628635:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628639:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628644:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628649:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628654:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628658:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628663:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628668:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628672:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628677:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628682:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628688:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628695:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628700:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628707:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628716:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628721:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628736:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628741:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628747:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628752:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628765:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628771:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.628776:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.629831:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8dfce07b8200:6707] 0 exiting: rc = 1 00000100:00100000:0.0:1789115568.632032:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8dfce07b8000:6708] 1 exiting: rc = 0 00000100:00100000:3.0:1789115568.632317:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632326:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632333:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632339:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632374:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632411:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632420:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632427:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632436:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632444:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632454:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632462:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632470:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632476:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632482:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632488:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632509:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632517:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632524:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632533:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632539:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632545:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632551:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632558:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632563:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632569:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632575:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632600:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632621:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632629:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632635:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632641:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632647:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632654:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632660:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632666:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632673:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632682:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632689:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632696:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632717:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632724:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632729:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632735:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632741:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632747:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632753:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632770:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632777:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632784:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632789:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632796:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632817:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632824:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632830:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632836:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632843:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632850:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632856:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632865:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632875:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632894:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632912:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789115568.632932:0:13760:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789115568.658893:0:13760:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789115586.376809:0:14375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789115594.075176:0:14836:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789115594.075193:0:14836:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789115594.075304:0:14836:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dfcc5730000 00000020:01000004:1.0:1789115594.075319:0:14836:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789115594.075327:0:14836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789115594.075342:0:14836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8dfcf5324ed8) 00000020:00000080:1.0:1789115594.075354:0:14836:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789115594.113298:0:14836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789115594.120968:0:14836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1789115594.121334:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1789115594.121495:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1789115594.122805:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1789115594.122927:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1789115594.123027:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1789115594.123216:0:14836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789115594.123289:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1789115594.124878:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1789115594.127272:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 589: rc = 0 00100000:10000000:3.0:1789115594.127372:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 589: rc = 0 00100000:10000000:3.0:1789115594.129244:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 646: rc = 0 00100000:10000000:3.0:1789115594.130876:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 646: rc = 0 00100000:10000000:3.0:1789115594.131158:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:3.0:1789115594.132215:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:3.0:1789115594.132784:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 646: rc = 0 00100000:10000000:3.0:1789115594.133053:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:3.0:1789115594.133345:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 646: rc = 0 00100000:10000000:3.0:1789115594.133664:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 646: rc = 0 00100000:10000000:3.0:1789115594.133911:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 646: rc = 0 00100000:10000000:3.0:1789115594.134160:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 646: rc = 0 00100000:10000000:3.0:1789115594.134453:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 646: rc = 0 00100000:10000000:2.0:1789115594.135854:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 646: rc = 0 00100000:10000000:2.0:1789115594.136300:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 196: rc = 0 00100000:10000000:2.0:1789115594.136786:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 196: rc = 0 00100000:10000000:2.0:1789115594.137032:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 196: rc = 0 00100000:10000000:2.0:1789115594.137272:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 196: rc = 0 00100000:10000000:2.0:1789115594.139002:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 196: rc = 0 00100000:10000000:2.0:1789115594.139302:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 196: rc = 0 00100000:10000000:2.0:1789115594.139792:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 196: rc = 0 00100000:10000000:2.0:1789115594.140038:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 196: rc = 0 00100000:10000000:2.0:1789115594.140283:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 196: rc = 0 00100000:10000000:2.0:1789115594.142632:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 196: rc = 0 00100000:10000000:2.0:1789115594.142937:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 196: rc = 0 00100000:10000000:2.0:1789115594.143187:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 196: rc = 0 00100000:10000000:2.0:1789115594.143447:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 196: rc = 0 00100000:10000000:2.0:1789115594.143720:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 196: rc = 0 00100000:10000000:2.0:1789115594.143969:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 196: rc = 0 00100000:10000000:2.0:1789115594.144211:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 196: rc = 0 00100000:10000000:2.0:1789115594.144514:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 196: rc = 0 00100000:10000000:2.0:1789115594.144799:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 196: rc = 0 00100000:10000000:2.0:1789115594.145048:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 196: rc = 0 00100000:10000000:2.0:1789115594.145301:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 196: rc = 0 00100000:10000000:2.0:1789115594.147821:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 196: rc = 0 00100000:10000000:2.0:1789115594.148231:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 196: rc = 0 00100000:10000000:2.0:1789115594.148503:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 196: rc = 0 00100000:10000000:2.0:1789115594.150135:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 196: rc = 0 00100000:10000000:2.0:1789115594.150406:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 196: rc = 0 00100000:10000000:2.0:1789115594.151100:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 196: rc = 0 00100000:10000000:2.0:1789115594.151339:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 196: rc = 0 00100000:10000000:2.0:1789115594.151778:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 196: rc = 0 00100000:10000000:2.0:1789115594.152006:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 196: rc = 0 00100000:10000000:2.0:1789115594.152221:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 196: rc = 0 00100000:10000000:2.0:1789115594.153204:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 196: rc = 0 00100000:10000000:2.0:1789115594.153464:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 196: rc = 0 00100000:10000000:2.0:1789115594.154001:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 344: rc = 0 00100000:10000000:2.0:1789115594.154482:0:14836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789115594.163166:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 590: rc = 0 00100000:10000000:2.0:1789115594.163461:0:14836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789115594.163602:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 590: rc = 0 00100000:10000000:2.0:1789115594.164149:0:14836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789115594.164224:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 590: rc = 0 00100000:10000000:0.0:1789115594.167455:0:14836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1789115594.167549:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 340: rc = 0 00100000:10000000:0.0:1789115594.167760:0:14836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1789115594.167837:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 340: rc = 0 00100000:10000000:0.0:1789115594.168033:0:14836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1789115594.168103:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 340: rc = 0 00000020:00000080:0.0:1789115594.168344:0:14836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789115594.168351:0:14836:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789115594.168359:0:14836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa47abda6516d413d 00000020:01000004:0.0:1789115594.168366:0:14836:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1789115594.168371:0:14836:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789115594.168375:0:14836:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dfcc5730000 from MGS 00000020:01000004:0.0:1789115594.168378:0:14836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789115594.168479:0:14836:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8dfcfbfc1a48) 00000020:00000080:0.0:1789115594.168488:0:14836:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789115594.168535:0:14836:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dfcc5730000 from MGS, refs=2 00080000:01000000:0.0:1789115594.168539:0:14836:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789115594.168544:0:14836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa47abda6516d414b 00000100:00100000:0.0:1789115594.168641:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789115594.168773:0:14836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789115594.168779:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789115594.169181:0:14836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789115594.169188:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789115594.170273:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789115594.170724:0:14836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789115594.170731:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789115594.171145:0:14836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789115594.171152:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789115594.171510:0:14836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789115594.171516:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789115594.172152:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115594.172156:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115594.172158:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115594.174423:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115594.174429:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115594.174431:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115594.175430:0:14836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789115594.183603:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789115594.188183:0:14836:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789115594.188204:0:14836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789115594.188207:0:14836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789115594.189820:0:14845:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789115594.189963:0:14836:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789115594.190061:0:14836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789115594.190549:0:14836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789115594.190863:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789115594.191019:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789115594.191024:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789115594.198083:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789115594.198098:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789115594.199231:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789115594.199241:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789115594.202192:0:14836:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789115594.202217:0:14836:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.131@tcp' 00000020:01000004:1.0:1789115594.202219:0:14836:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789115594.202250:0:14836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.131@tcp (typ=mgc) 00000020:00000080:1.0:1789115594.202264:0:14836:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.131@tcp (ffff8dfcf5323490) 00000020:00000080:1.0:1789115594.202279:0:14836:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789115594.202348:0:14836:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dfcc5737800@MGC192.168.203.131@tcp: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1789115594.202512:0:14836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.131@tcp-0 is initialized 00000040:01000000:1.0:1789115594.202517:0:14836:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789115594.208255:0:14851:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00080000:2.0:1789115594.208317:0:14850:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1789115594.208317:0:14836:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.131@tcp (uuid 91237388-4e21-4f8d-88fa-5d733c21b708) 00000020:00000080:0.0:1789115594.208339:0:14836:0:(genops.c:1385:class_connect()) connect: client 91237388-4e21-4f8d-88fa-5d733c21b708, cookie 0xa47abda6516d4159 00000100:00080000:0.0:1789115594.208351:0:14836:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789115594.208356:0:14836:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff8dfcc5737800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1789115594.208405:0:14836:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfbc2571a40 x1876023308281856/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789115594.208427:0:14836:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 91237388-4e21-4f8d-88fa-5d733c21b708->MGS 00000020:01000004:0.0:1789115594.208441:0:14836:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789115594.208447:0:14836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789115594.208459:0:14836:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8dfcfbfc0000) 00000020:00000080:0.0:1789115594.208471:0:14836:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789115594.208477:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2571a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91237388-4e21-4f8d-88fa-5d733c21b708:3304:1876023308281856:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789115594.208538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115594.208625:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308281856 00000100:00100000:2.0:1789115594.208632:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308281856 00000100:00100000:2.0:1789115594.208667:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789115594.208674:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc66eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1876023308281856:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789115594.208695:0:14846:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 91237388-4e21-4f8d-88fa-5d733c21b708@0@lo t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:2.0:1789115594.208716:0:14846:0:(genops.c:1385:class_connect()) connect: client 91237388-4e21-4f8d-88fa-5d733c21b708, cookie 0xa47abda6516d4167 00000100:00080000:2.0:1789115594.208835:0:14846:0:(import.c:65:import_set_state_nolock()) ffff8dfcd8bae000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789115594.208883:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc66eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+5:3304:x1876023308281856:12345-0@lo:250:mount.lustre.0 Request processed in 207us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115594.208890:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789115594.208928:0:3304:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789115594.208936:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.131@tcp: connect to target with instance 0 00000100:00080000:2.0:1789115594.208942:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789115594.208945:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789115594.208948:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcc5737800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789115594.208951:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789115594.208960:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789115594.208965:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2571a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91237388-4e21-4f8d-88fa-5d733c21b708:3304:1876023308281856:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789115594.221768:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789115594.221969:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789115594.221977:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789115594.224620:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789115594.224634:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789115594.227784:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789115594.227799:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789115594.231856:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789115594.232056:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789115594.232062:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789115594.238112:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789115594.238132:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789115594.327503:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789115594.328189:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789115594.328197:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789115594.335157:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789115594.335173:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789115594.336725:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789115594.336900:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789115594.336906:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789115594.338102:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789115594.338112:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789115594.339205:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789115594.339366:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789115594.339372:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789115594.344278:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789115594.344294:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789115594.345335:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789115594.345733:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789115594.345739:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789115594.346279:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789115594.346286:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789115594.369227:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789115594.369495:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789115594.369502:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789115594.372988:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789115594.373004:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789115594.383853:0:14836:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789115594.383869:0:14836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789115594.387839:0:14836:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789115594.387867:0:14836:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789115594.387874:0:14836:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789115594.388027:0:14836:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789115594.388063:0:14836:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789115594.388067:0:14836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789115594.388069:0:14836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789115594.388070:0:14836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789115594.388071:0:14836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789115594.388072:0:14836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789115594.388073:0:14836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789115594.388075:0:14836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789115594.388076:0:14836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789115594.388077:0:14836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789115594.388079:0:14836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789115594.388081:0:14836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789115594.388084:0:14836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789115594.388085:0:14836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789115594.388086:0:14836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789115594.388087:0:14836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789115594.388088:0:14836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789115594.388089:0:14836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789115594.388090:0:14836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789115594.388091:0:14836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789115594.388092:0:14836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789115594.388093:0:14836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789115594.388118:0:14836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789115594.388138:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308281984:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789115594.388214:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115594.388269:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc5672f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789115594.388416:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308281984 00000100:00100000:2.0:1789115594.388423:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308281984 00000100:00100000:2.0:1789115594.388468:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789115594.388477:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+5:14836:x1876023308281984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789115594.388529:0:14849:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789115594.388533:0:14849:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789115594.388536:0:14849:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789115594.391861:0:14870:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789115594.392297:0:14849:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1789115594.394367:0:14871:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789115594.394374:0:14871:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789115594.394377:0:14871:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789115594.394504:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1789115594.394934:0:14849:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789115594.394945:0:14849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789115594.409366:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+5:14836:x1876023308281984:12345-0@lo:253:mount.lustre.0 Request processed in 20882us (21143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115594.409416:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789115594.409552:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308281984:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789115594.409568:0:14836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789115594.409572:0:14836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789115594.409573:0:14836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789115594.409574:0:14836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789115594.409576:0:14836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789115594.409577:0:14836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789115594.409578:0:14836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789115594.409580:0:14836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789115594.409590:0:14836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789115594.409593:0:14836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789115594.409594:0:14836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789115594.409614:0:14836:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dfcc5730000 from lustre-MDT0000 10000000:01000000:1.0:1789115594.409640:0:14836:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789115594.409658:0:14836:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789115594.409662:0:14836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8dfcf5323490 10000000:01000000:1.0:1789115594.409666:0:14836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789115594.409673:0:14836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dfcf5323490 from 1 10000000:01000000:1.0:1789115594.409676:0:14836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789115594.409714:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6a00/0xa47abda6516d416e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.409725:0:14836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6a00/0xa47abda6516d416e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.409735:0:14836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6a00/0xa47abda6516d416e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115594.409754:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308282112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789115594.409806:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115594.409848:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bf240 going to sleep for 11 seconds 00000100:00100000:2.0:1789115594.409908:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308282112 00000100:00100000:2.0:1789115594.409914:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308282112 00000100:00100000:2.0:1789115594.409958:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789115594.409967:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+5:14836:x1876023308282112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789115594.409981:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115594.409995:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedacd600/0xa47abda6516d4175 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d416e expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.410019:0:14848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedacd600/0xa47abda6516d4175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d416e expref: 6 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.410030:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedacd600/0xa47abda6516d4175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d416e expref: 6 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.410052:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacd600, rc 0) 00000100:00100000:2.0:1789115594.410103:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+6:14836:x1876023308282112:12345-0@lo:101:mount.lustre.0 Request processed in 137us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115594.410109:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789115594.410275:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308282112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789115594.410288:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6a00/0xa47abda6516d416e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4175 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.410296:0:14836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6a00/0xa47abda6516d416e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d4175 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115594.410341:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308282240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115594.410365:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115594.410420:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bf240 going to sleep for 11 seconds 00000100:00100000:3.0:1789115594.410535:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308282240 00000100:00100000:3.0:1789115594.410540:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308282240 00000100:00100000:3.0:1789115594.410572:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789115594.410578:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+6:14836:x1876023308282240:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789115594.410815:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+6:14836:x1876023308282240:12345-0@lo:501:mount.lustre.0 Request processed in 236us (448us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789115594.410823:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789115594.410895:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308282240:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789115594.410922:0:14836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789115594.410949:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6a00/0xa47abda6516d416e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4175 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.410958:0:14836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6a00/0xa47abda6516d416e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4175 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115594.410967:0:14836:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dfcc5730000 10000000:01000000:1.0:1789115594.410972:0:14836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789115594.410976:0:14836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dfcc5730000 10000000:01000000:1.0:1789115594.410979:0:14836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789115594.410982:0:14836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dfcc5730000 from 1 10000000:01000000:1.0:1789115594.410984:0:14836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789115594.411003:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7e00/0xa47abda6516d417c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.411010:0:14836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7e00/0xa47abda6516d417c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.411018:0:14836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7e00/0xa47abda6516d417c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115594.411031:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308282368:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789115594.411056:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115594.411094:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bf240 going to sleep for 11 seconds 00000100:00100000:2.0:1789115594.411239:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308282368 00000100:00100000:2.0:1789115594.411244:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308282368 00000100:00100000:2.0:1789115594.411275:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789115594.411283:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+6:14836:x1876023308282368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789115594.411293:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115594.411304:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedacc200/0xa47abda6516d4183 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d417c expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.411319:0:14848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedacc200/0xa47abda6516d4183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d417c expref: 7 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.411327:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedacc200/0xa47abda6516d4183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d417c expref: 7 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.411335:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacc200, rc 0) 00000100:00100000:2.0:1789115594.411372:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+7:14836:x1876023308282368:12345-0@lo:101:mount.lustre.0 Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115594.411378:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789115594.411547:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308282368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789115594.411558:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7e00/0xa47abda6516d417c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4183 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.411565:0:14836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7e00/0xa47abda6516d417c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d4183 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115594.411595:0:14836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789115594.411607:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7e00/0xa47abda6516d417c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4183 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.411614:0:14836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7e00/0xa47abda6516d417c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4183 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115594.411620:0:14836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789115594.411625:0:14836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789115594.411629:0:14836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dfcc5730000 10000000:01000000:1.0:1789115594.411631:0:14836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789115594.411635:0:14836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789115594.411636:0:14836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789115594.411652:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7a00/0xa47abda6516d418a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.411659:0:14836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7a00/0xa47abda6516d418a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.411666:0:14836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7a00/0xa47abda6516d418a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115594.411679:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308282496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789115594.411707:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115594.411733:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bf240 going to sleep for 11 seconds 00000100:00100000:2.0:1789115594.411803:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308282496 00000100:00100000:2.0:1789115594.411808:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308282496 00000100:00100000:2.0:1789115594.411836:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789115594.411843:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+7:14836:x1876023308282496:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789115594.411851:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115594.411865:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedacd200/0xa47abda6516d4191 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d418a expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.411879:0:14848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedacd200/0xa47abda6516d4191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d418a expref: 8 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.411887:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedacd200/0xa47abda6516d4191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d418a expref: 8 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.411894:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacd200, rc 0) 00000100:00100000:2.0:1789115594.411929:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+8:14836:x1876023308282496:12345-0@lo:101:mount.lustre.0 Request processed in 86us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115594.411934:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789115594.412025:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308282496:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789115594.412036:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7a00/0xa47abda6516d418a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4191 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.412048:0:14836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7a00/0xa47abda6516d418a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d4191 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115594.412162:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308282624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115594.412188:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115594.412206:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bf240 going to sleep for 11 seconds 00000100:00100000:3.0:1789115594.412254:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308282624 00000100:00100000:3.0:1789115594.412258:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308282624 00000100:00100000:3.0:1789115594.412286:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789115594.412293:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+8:14836:x1876023308282624:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789115594.415570:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+9:14836:x1876023308282624:12345-0@lo:501:mount.lustre.0 Request processed in 3265us (3369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115594.415593:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789115594.415740:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308282624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115594.415796:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308282752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789115594.415846:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115594.415887:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88bf240 going to sleep for 11 seconds 00000100:00100000:2.0:1789115594.416177:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308282752 00000100:00100000:2.0:1789115594.416184:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308282752 00000100:00100000:2.0:1789115594.416231:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789115594.416240:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+9:14836:x1876023308282752:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789115594.416555:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+9:14836:x1876023308282752:12345-0@lo:503:mount.lustre.0 Request processed in 315us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115594.416562:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789115594.416672:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308282752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789115594.418364:0:14872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc099680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91237388-4e21-4f8d-88fa-5d733c21b708:14872:1876023308282880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789115594.418454:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115594.418502:0:14872:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc2f07180 going to sleep for 11 seconds 00000100:00100000:2.0:1789115594.418630:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308282880 00000100:00100000:2.0:1789115594.418636:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308282880 00000100:00100000:2.0:1789115594.418680:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789115594.418689:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+9:14872:x1876023308282880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115594.421891:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+9:14872:x1876023308282880:12345-0@lo:502:llog_process_th.0 Request processed in 3193us (3427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115594.421907:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789115594.422187:0:14872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc099680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91237388-4e21-4f8d-88fa-5d733c21b708:14872:1876023308282880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789115594.422230:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789115594.422241:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115594.422243:0:14872:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789115594.422260:0:14872:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789115594.422263:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789115594.422278:0:14872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8dfcd8a40000) 00000020:00000080:3.0:1789115594.422298:0:14872:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789115594.422303:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789115594.423173:0:14872:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789115594.423186:0:14872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa47abda6516d419f 00000020:00000080:3.0:1789115594.423521:0:14872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789115594.423528:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789115594.423533:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115594.423534:0:14872:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789115594.423537:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789115594.423541:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115594.423543:0:14872:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789115594.423547:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789115594.423557:0:14872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8dfcd8a43490) 00000020:00000080:3.0:1789115594.423568:0:14872:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789115594.423572:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789115594.423574:0:14872:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789115594.423576:0:14872:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789115594.423592:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789115594.423645:0:14872:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dfcc5730000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789115594.423657:0:14872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8dfcd8a41a48) 00000020:00000080:3.0:1789115594.423665:0:14872:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789115594.423724:0:14872:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789115594.423730:0:14872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa47abda6516d41b4 00000020:00000080:3.0:1789115594.423814:0:14872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789115594.423820:0:14872:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789115594.423824:0:14872:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa47abda6516d41bb 00080000:01000000:3.0:1789115594.423829:0:14872:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789115594.423832:0:14872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa47abda6516d41c2 00010000:00010000:3.0:1789115594.526258:0:14872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789115594.526838:0:14872:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1789115594.527022:0:14872:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789115594.529909:0:14872:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8dfcd8a44ed8) 00000020:00000080:3.0:1789115594.529935:0:14872:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789115594.530013:0:14872:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789115594.530022:0:14872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa47abda6516d41d0 00000020:00000080:3.0:1789115594.545480:0:14872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789115594.561000:0:14872:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa47abda6516d41d7 00000020:00000080:2.0:1789115594.562301:0:14872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789115594.562313:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115594.562319:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115594.562321:0:14872:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789115594.562324:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789115594.562330:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115594.562331:0:14872:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789115594.562335:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789115594.562373:0:14872:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789115594.562422:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115594.562426:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115594.562427:0:14872:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789115594.562430:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789115594.562433:0:14872:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1789115594.562435:0:14872:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789115594.562437:0:14872:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789115594.562438:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789115594.562441:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115594.562443:0:14872:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789115594.562445:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789115594.562449:0:14872:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789115594.562452:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115594.562454:0:14872:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789115594.562458:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789115594.562464:0:14872:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:2.0:1789115594.562489:0:14872:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789115594.562492:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789115594.562506:0:14872:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dfcd8a78000) 00000020:00000080:2.0:1789115594.562522:0:14872:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789115594.562529:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789115594.568695:0:14872:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789115594.568707:0:14872:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789115594.568719:0:14872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa47abda6516d41e5 00010000:00080000:3.0:1789115594.568762:0:14872:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dfcc836c800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1789115594.569289:0:14872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789115594.570901:0:14872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789115594.570971:0:14872:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789115594.575264:0:14872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789115594.575328:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789115594.575448:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789115594.576786:0:14876:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789115594.576792:0:14876:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789115594.578947:0:14872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789115594.578962:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789115594.579013:0:14872:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789115594.579032:0:14872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa47abda6516d41ec 00000100:00080000:1.0:1789115594.579042:0:14872:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789115594.579047:0:14872:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dfcc836c800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1789115594.579083:0:14872:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfcfc330000 x1876023308283008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789115594.579108:0:14872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789115594.579169:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115594.579173:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115594.579175:0:14872:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789115594.579178:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789115594.579181:0:14872:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1789115594.579187:0:14872:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789115594.579190:0:14872:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789115594.579191:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789115594.579194:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115594.579195:0:14872:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789115594.579198:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789115594.579202:0:14872:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789115594.579207:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115594.579208:0:14872:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789115594.579211:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789115594.579214:0:14872:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:1.0:1789115594.579237:0:14872:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789115594.579240:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789115594.579252:0:14872:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dfcf5321a48) 00000020:00000080:1.0:1789115594.579263:0:14872:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789115594.579268:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789115594.579321:0:14872:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789115594.579327:0:14872:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789115594.579333:0:14872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa47abda6516d41fa 00010000:00080000:1.0:1789115594.579360:0:14872:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dfcc4f4f000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1789115594.580711:0:14872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789115594.581238:0:14872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789115594.581262:0:14872:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789115594.581805:0:14872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789115594.581873:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789115594.581942:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1789115594.582101:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308283008:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789115594.582156:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876023308283008 offset 0 length 520: 4 00000040:00080000:3.0:1789115594.584078:0:14878:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789115594.584085:0:14878:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789115594.585901:0:14872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789115594.585914:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789115594.585948:0:14872:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789115594.585967:0:14872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa47abda6516d4201 00000100:00080000:1.0:1789115594.585979:0:14872:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789115594.585984:0:14872:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dfcc4f4f000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1789115594.586029:0:14872:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfcfc331680 x1876023308283136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789115594.586058:0:14872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789115594.586164:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc331680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308283136:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789115594.586228:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876023308283136 offset 0 length 520: 4 00000020:01000000:1.0:1789115594.586352:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115594.586357:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115594.586359:0:14872:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789115594.586361:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115594.586365:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115594.586367:0:14872:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789115594.586369:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789115594.586371:0:14872:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789115594.586373:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115594.586376:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115594.586377:0:14872:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789115594.586403:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115594.586407:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115594.586409:0:14872:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789115594.586413:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789115594.586442:0:14872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91237388-4e21-4f8d-88fa-5d733c21b708:14872:1876023308283264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115594.586494:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115594.586642:0:14872:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc5512180 going to sleep for 11 seconds 00000100:00100000:0.0:1789115594.586977:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308283264 00000100:00100000:0.0:1789115594.586985:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308283264 00000100:00100000:0.0:1789115594.587033:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789115594.587042:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+9:14872:x1876023308283264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789115594.587309:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+9:14872:x1876023308283264:12345-0@lo:502:llog_process_th.0 Request processed in 267us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115594.587317:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789115594.587518:0:14872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91237388-4e21-4f8d-88fa-5d733c21b708:14872:1876023308283264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789115594.587547:0:14872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789115594.587553:0:14872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115594.587554:0:14872:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789115594.587558:0:14872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789115594.587719:0:14836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1789115594.587741:0:14836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789115594.587753:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7a00/0xa47abda6516d418a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4191 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.587764:0:14836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7a00/0xa47abda6516d418a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4191 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115594.587772:0:14836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dfcc5730000 from 1 10000000:01000000:2.0:1789115594.587774:0:14836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789115594.587803:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.587810:0:14836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.587819:0:14836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115594.587835:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc57392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308283392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789115594.587880:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115594.587916:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789115594.588013:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308283392 00000100:00100000:1.0:1789115594.588018:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308283392 00000100:00100000:1.0:1789115594.588042:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789115594.588049:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+9:14836:x1876023308283392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789115594.588070:0:14846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115594.588084:0:14846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d420f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d4208 expref: -99 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.588105:0:14846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d420f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d4208 expref: 10 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.588123:0:14846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d420f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d4208 expref: 10 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.588133:0:14846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6200, rc 0) 00000100:00100000:1.0:1789115594.588162:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+10:14836:x1876023308283392:12345-0@lo:101:mount.lustre.0 Request processed in 113us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115594.588168:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789115594.588291:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc57392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308283392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789115594.588304:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d420f expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.588311:0:14836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d420f expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115594.588875:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc57392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308283520:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789115594.588915:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115594.588936:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789115594.589057:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308283520 00000100:00100000:3.0:1789115594.589073:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308283520 00000100:00100000:3.0:1789115594.589097:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789115594.589103:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+10:14836:x1876023308283520:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789115594.589126:0:14848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789115594.589132:0:14848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789115594.589193:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+10:14836:x1876023308283520:12345-0@lo:256:mount.lustre.0 Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115594.589200:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789115594.589350:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc57392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308283520:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789115594.589950:0:14836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789115594.589960:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d420f expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.589970:0:14836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d420f expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115594.589978:0:14836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcc5730000 from 1 10000000:01000000:2.0:1789115594.589981:0:14836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789115594.590008:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.590015:0:14836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.590024:0:14836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115594.590039:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc57392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308283648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789115594.592292:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115594.592345:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789115594.592494:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308283648 00000100:00100000:3.0:1789115594.592503:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308283648 00000100:00100000:3.0:1789115594.592548:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789115594.592558:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+10:14836:x1876023308283648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789115594.592572:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115594.592603:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcff9ea800/0xa47abda6516d421d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d4216 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115594.592638:0:14848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcff9ea800/0xa47abda6516d421d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d4216 expref: 11 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115594.592648:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcff9ea800/0xa47abda6516d421d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d4216 expref: 11 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115594.592657:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ea800, rc 0) 00000100:00100000:3.0:1789115594.592714:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+11:14836:x1876023308283648:12345-0@lo:101:mount.lustre.0 Request processed in 157us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115594.592720:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789115594.592822:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc57392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308283648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789115594.592839:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d421d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.592848:0:14836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d421d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115594.592913:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308283776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115594.592946:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115594.592974:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd9719900 going to sleep for 11 seconds 00000100:00100000:3.0:1789115594.593185:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308283776 00000100:00100000:3.0:1789115594.593190:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308283776 00000100:00100000:3.0:1789115594.593221:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789115594.593229:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+11:14836:x1876023308283776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789115594.593640:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+11:14836:x1876023308283776:12345-0@lo:501:mount.lustre.0 Request processed in 411us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115594.593656:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789115594.593739:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308283776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115594.593770:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308283904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789115594.593810:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115594.593838:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd9719900 going to sleep for 11 seconds 00000100:00100000:0.0:1789115594.594017:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308283904 00000100:00100000:0.0:1789115594.594023:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308283904 00000100:00100000:0.0:1789115594.594056:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789115594.594072:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+11:14836:x1876023308283904:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789115594.594254:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+11:14836:x1876023308283904:12345-0@lo:503:mount.lustre.0 Request processed in 191us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115594.594262:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789115594.594416:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308283904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789115594.598240:0:14880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91237388-4e21-4f8d-88fa-5d733c21b708:14880:1876023308284032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115594.598332:0:14880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115594.598377:0:14880:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd0dca600 going to sleep for 11 seconds 00000100:00100000:0.0:1789115594.598570:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308284032 00000100:00100000:0.0:1789115594.598578:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308284032 00000100:00100000:0.0:1789115594.598635:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789115594.598644:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+11:14880:x1876023308284032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789115594.598913:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+11:14880:x1876023308284032:12345-0@lo:502:llog_process_th.0 Request processed in 269us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115594.598921:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789115594.599089:0:14880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91237388-4e21-4f8d-88fa-5d733c21b708:14880:1876023308284032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789115594.599119:0:14880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789115594.599128:0:14880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115594.599130:0:14880:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789115594.599136:0:14880:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dfcc5730000 00000020:00000080:2.0:1789115594.599139:0:14880:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789115594.599148:0:14880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115594.599150:0:14880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115594.599152:0:14880:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789115594.599155:0:14880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789115594.599157:0:14880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115594.599158:0:14880:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789115594.599161:0:14880:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dfcc5730000 00000020:00000080:2.0:1789115594.599163:0:14880:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789115594.599217:0:14880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115594.599221:0:14880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115594.599223:0:14880:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789115594.599225:0:14880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789115594.599228:0:14880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115594.599230:0:14880:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789115594.599233:0:14880:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dfcc5730000 00000020:00000080:2.0:1789115594.599236:0:14880:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789115594.599256:0:14880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115594.599259:0:14880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115594.599260:0:14880:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789115594.599263:0:14880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789115594.599266:0:14880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115594.599273:0:14880:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789115594.599278:0:14880:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dfcc5730000 00000020:00000080:2.0:1789115594.599280:0:14880:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789115594.599319:0:14880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91237388-4e21-4f8d-88fa-5d733c21b708:14880:1876023308284160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789115594.599363:0:14880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115594.599413:0:14880:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd0dca600 going to sleep for 11 seconds 00000100:00100000:1.0:1789115594.599632:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308284160 00000100:00100000:1.0:1789115594.599638:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308284160 00000100:00100000:1.0:1789115594.599667:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789115594.599675:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+11:14880:x1876023308284160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115594.599849:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+11:14880:x1876023308284160:12345-0@lo:502:llog_process_th.0 Request processed in 174us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115594.599856:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789115594.599938:0:14880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91237388-4e21-4f8d-88fa-5d733c21b708:14880:1876023308284160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789115594.599959:0:14880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115594.599964:0:14880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115594.599966:0:14880:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789115594.599969:0:14880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789115594.611199:0:14836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789115594.611235:0:14836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789115594.611263:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d421d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115594.611276:0:14836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d421d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115594.611324:0:14836:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789115594.611327:0:14836:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dfcc5730000 10000000:01000000:3.0:1789115594.611330:0:14836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dfcc5730000 10000000:01000000:3.0:1789115594.611334:0:14836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789115594.611340:0:14836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dfcc5730000 from 1 10000000:01000000:3.0:1789115594.611342:0:14836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789115594.611377:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcff9eac00/0xa47abda6516d4224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115594.611402:0:14836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcff9eac00/0xa47abda6516d4224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115594.611414:0:14836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcff9eac00/0xa47abda6516d4224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115594.611436:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc099680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308284288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789115594.611503:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115594.611545:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1241780 going to sleep for 11 seconds 00000100:00100000:1.0:1789115594.612195:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308284288 00000100:00100000:1.0:1789115594.612204:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308284288 00000100:00100000:1.0:1789115594.612261:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789115594.612271:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+11:14836:x1876023308284288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789115594.612283:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115594.612296:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedac7600/0xa47abda6516d422b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d4224 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.612319:0:14848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedac7600/0xa47abda6516d422b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d4224 expref: 12 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.612329:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedac7600/0xa47abda6516d422b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d4224 expref: 12 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.612337:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7600, rc 0) 00000100:00100000:1.0:1789115594.612406:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+12:14836:x1876023308284288:12345-0@lo:101:mount.lustre.0 Request processed in 137us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115594.612414:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789115594.613605:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc099680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308284288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789115594.613632:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcff9eac00/0xa47abda6516d4224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d422b expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115594.613653:0:14836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcff9eac00/0xa47abda6516d4224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d422b expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115594.613728:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc099680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308284416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789115594.613779:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115594.613809:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1241780 going to sleep for 11 seconds 00000100:00100000:1.0:1789115594.614459:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308284416 00000100:00100000:1.0:1789115594.614467:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308284416 00000100:00100000:1.0:1789115594.614514:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789115594.614522:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+12:14836:x1876023308284416:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115594.622174:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+12:14836:x1876023308284416:12345-0@lo:501:mount.lustre.0 Request processed in 7644us (8385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115594.622197:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789115594.622271:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc099680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308284416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115594.622324:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308284544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789115594.622378:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115594.622439:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd9719a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789115594.625467:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308284544 00000100:00100000:0.0:1789115594.625482:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308284544 00000100:00100000:0.0:1789115594.625544:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789115594.625553:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+12:14836:x1876023308284544:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789115594.625782:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+12:14836:x1876023308284544:12345-0@lo:503:mount.lustre.0 Request processed in 230us (3404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115594.625789:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789115594.626042:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308284544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789115594.626503:0:14884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91237388-4e21-4f8d-88fa-5d733c21b708:14884:1876023308284672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115594.626555:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115594.626601:0:14884:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd9719f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115594.627163:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308284672 00000100:00100000:0.0:1789115594.627169:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308284672 00000100:00100000:0.0:1789115594.627209:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789115594.627217:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1189050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+12:14884:x1876023308284672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789115594.627467:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1189050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+12:14884:x1876023308284672:12345-0@lo:502:llog_process_th.0 Request processed in 250us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115594.627475:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789115594.627525:0:14884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91237388-4e21-4f8d-88fa-5d733c21b708:14884:1876023308284672:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789115594.627613:0:14884:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789115594.627628:0:14884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8dfcfbfc4ed8) 00000020:00000080:0.0:1789115594.627647:0:14884:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1789115594.627715:0:14884:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dfcc5730000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789115594.627719:0:14884:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dfcc5730000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789115594.627722:0:14884:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dfcc5730000 4 00010000:00080000:0.0:1789115594.627750:0:14884:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dfcd1a61800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1789115594.639291:0:14884:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1789115594.652204:0:14884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789115594.652246:0:14884:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789115594.652260:0:14884:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa47abda6516d4239 00000100:00080000:1.0:1789115594.652270:0:14884:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789115594.652277:0:14884:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dfcd1a61800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1789115594.652312:0:14884:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfcfc332940 x1876023308284800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789115594.652346:0:14884:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789115594.652432:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876023308284800:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789115594.652499:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115594.652856:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308284800 00000100:00100000:0.0:1789115594.652863:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308284800 00000100:00100000:0.0:1789115594.652900:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789115594.652912:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876023308284800:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789115594.652971:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876023308284800:12345-0@lo:38:llog_process_th.0 Request processed in 59us (472us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789115594.652978:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789115594.653013:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789115594.653021:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcd1a61800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789115594.653025:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789115594.653028:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876023308284800:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789115594.655839:0:14884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91237388-4e21-4f8d-88fa-5d733c21b708:14884:1876023308284928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115594.655920:0:14884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115594.655956:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308284928 00000100:00100000:1.0:1789115594.655962:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308284928 00000100:00100000:1.0:1789115594.656005:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789115594.656013:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+12:14884:x1876023308284928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789115594.656236:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+12:14884:x1876023308284928:12345-0@lo:502:llog_process_th.0 Request processed in 223us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115594.656244:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789115594.656288:0:14884:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd97190c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789115594.656306:0:14884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91237388-4e21-4f8d-88fa-5d733c21b708:14884:1876023308284928:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789115594.656329:0:14884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789115594.656441:0:14836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789115594.656462:0:14836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789115594.656476:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcff9eac00/0xa47abda6516d4224 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d422b expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115594.656486:0:14836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcff9eac00/0xa47abda6516d4224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d422b expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789115594.656528:0:14836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789115594.656531:0:14836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789115594.656532:0:14836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789115594.656533:0:14836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789115594.656534:0:14836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789115594.656536:0:14836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789115594.656537:0:14836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789115594.656538:0:14836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789115594.656540:0:14836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789115594.656542:0:14836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789115594.656545:0:14836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789115594.656548:0:14836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789115594.656549:0:14836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789115594.656550:0:14836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789115594.656554:0:14836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789115594.656555:0:14836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789115594.656556:0:14836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789115594.656557:0:14836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789115594.656558:0:14836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789115594.656559:0:14836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789115594.656560:0:14836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789115594.656573:0:14836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789115594.656593:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308285056:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789115594.656628:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115594.656648:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1241c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789115594.656664:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308285056 00000100:00100000:1.0:1789115594.656668:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308285056 00000100:00100000:1.0:1789115594.656688:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789115594.656695:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+12:14836:x1876023308285056:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789115594.656712:0:14846:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789115594.656725:0:14846:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789115594.696733:0:14846:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789115594.696746:0:14846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789115594.698155:0:14870:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789115594.698163:0:14870:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789115594.698185:0:14870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.698204:0:14870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d420f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d4208 expref: 12 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.698213:0:14870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.698269:0:14870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d420f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d4208 expref: 12 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.698284:0:14870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d420f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d4208 expref: 12 pid: 14846 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115594.698298:0:14870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2571a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14870:1876023308285184:0@lo:104: 00000100:00100000:0.0:1789115594.698360:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115594.698427:0:14870:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc62d4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789115594.698432:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308285184 00000100:00100000:2.0:1789115594.698440:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308285184 00000100:00100000:2.0:1789115594.698530:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789115594.698541:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2570f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91237388-4e21-4f8d-88fa-5d733c21b708+3:14870:x1876023308285184:12345-0@lo:104: 00010000:00010000:2.0:1789115594.698554:0:14837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d420f expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115594.698611:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789115594.698617:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2570f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91237388-4e21-4f8d-88fa-5d733c21b708+3:14870:x1876023308285184:12345-0@lo:104: Request processed in 79us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115594.698625:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789115594.698746:0:14870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2571a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14870:1876023308285184:0@lo:104: 00010000:00010000:0.0:1789115594.698763:0:14870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115594.699402:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115594.699410:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d420f expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115594.699419:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc000 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115594.699422:0:14843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d420f expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115594.699431:0:14843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d420f expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115594.699439:0:14843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d420f expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115594.699445:0:14843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789115594.699480:0:14843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d420f expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115594.699487:0:14843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115594.699512:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d420f expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115594.699532:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4208 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d420f expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115594.699548:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115594.699550:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115594.699552:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115594.699578:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115594.700149:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91237388-4e21-4f8d-88fa-5d733c21b708:3307:1876023308285312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789115594.700200:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115594.700294:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308285312 00000100:00100000:0.0:1789115594.700300:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308285312 00010000:00010000:0.0:1789115594.700323:0:14839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d420f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d4208 expref: 13 pid: 14846 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115594.700355:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789115594.700362:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91237388-4e21-4f8d-88fa-5d733c21b708+13:3307:x1876023308285312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789115594.700374:0:14839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115594.700378:0:14839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d420f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d4208 expref: 13 pid: 14846 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.700418:0:14839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d420f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d4208 expref: 13 pid: 14846 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.700431:0:14839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcedac6200/0xa47abda6516d420f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d4208 expref: 13 pid: 14846 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.700451:0:14839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.700459:0:14839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789115594.700472:0:14839:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002309467s 00010000:00010000:0.0:1789115594.700477:0:14839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.700484:0:14839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.700491:0:14839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.700498:0:14839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.700503:0:14839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2600 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115594.700507:0:14839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.700514:0:14839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.700529:0:14839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115594.700538:0:14839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115594.700588:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91237388-4e21-4f8d-88fa-5d733c21b708+12:3307:x1876023308285312:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115594.700596:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789115594.700629:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91237388-4e21-4f8d-88fa-5d733c21b708:3307:1876023308285312:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789115594.700689:0:14870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.700698:0:14870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115594.700704:0:14870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d4240 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115594.703897:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+11:14836:x1876023308285056:12345-0@lo:253:mount.lustre.0 Request processed in 47194us (47260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115594.703912:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789115594.704252:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:14836:1876023308285056:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789115594.704268:0:14836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789115594.704271:0:14836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789115594.704272:0:14836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789115594.704274:0:14836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789115594.704275:0:14836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789115594.704276:0:14836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789115594.704277:0:14836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789115594.704278:0:14836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789115594.704280:0:14836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789115594.704281:0:14836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789115594.704283:0:14836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789115594.704302:0:14836:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789115594.710696:0:14836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789115594.710880:0:14836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789115594.711239:0:14836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789115594.711717:0:14836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789115594.711975:0:14836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789115594.712275:0:14836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789115594.713181:0:14836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789115594.713347:0:14836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789115594.713829:0:14836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789115594.714323:0:14836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789115594.714641:0:14836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789115594.714802:0:14836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1789115594.743618:0:14836:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789115594.744051:0:14836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1789115594.744510:0:14895:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1789115594.744589:0:14895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1789115594.745560:0:14894:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789115594.745565:0:14894:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789115594.749218:0:14836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789115594.749877:0:14836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789115594.750978:0:14836:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789115594.750995:0:14836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789115594.751367:0:14836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789115594.751651:0:14895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789115594.751768:0:14895:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789115594.751773:0:14895:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1789115594.752606:0:14836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789115594.753120:0:14836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789115594.753199:0:14836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789115594.753957:0:14836:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1789115594.754872:0:14836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789115594.763798:0:14836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789115594.803664:0:14836:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789115594.803696:0:14836:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaea7818eb988 00100000:10000000:3.0:1789115594.803704:0:14836:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789115594.804228:0:14836:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789115594.804243:0:14836:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789115594.804258:0:14836:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789115594.804278:0:14836:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789115595.236040:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789115595.494252:0:14851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789115595.494259:0:14851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dfcc5730000 from 6 10000000:01000000:0.0:1789115595.494264:0:14851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789115595.494350:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115595.494363:0:14851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115595.494375:0:14851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115595.494425:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc25730c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308285440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789115595.494517:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115595.494585:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc62d46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789115595.494871:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308285440 00000100:00100000:1.0:1789115595.494880:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308285440 00000100:00100000:1.0:1789115595.494939:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789115595.494949:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+11:14851:x1876023308285440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115595.494970:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115595.494985:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d424e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d4247 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115595.495009:0:14848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d424e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d4247 expref: 12 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115595.495019:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d424e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d4247 expref: 12 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115595.495029:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7400, rc 0) 00000100:00100000:1.0:1789115595.495107:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+12:14851:x1876023308285440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115595.495114:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789115595.495152:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc25730c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308285440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789115595.495170:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d424e expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115595.495181:0:14851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d424e expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115595.495235:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308285568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789115595.495270:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115595.495299:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfce06c7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789115595.495364:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308285568 00000100:00100000:0.0:1789115595.495370:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308285568 00000100:00100000:0.0:1789115595.495425:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789115595.495434:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+12:14851:x1876023308285568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789115595.495449:0:14849:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789115595.495464:0:14849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789115595.495468:0:14849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789115595.495587:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+12:14851:x1876023308285568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115595.495595:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789115595.495630:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308285568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789115595.495677:0:14851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789115595.495684:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d424e expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115595.495693:0:14851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d424e expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789115595.689768:0:14889:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789115595.689777:0:14889:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789115595.691775:0:14889:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789115595.691787:0:14889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789115596.265016:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789115596.711842:0:14889:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789115596.711854:0:14889:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789115596.712686:0:14889:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789115596.712752:0:14889:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789115596.712788:0:14889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1789115597.295938:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115598.307689:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789115599.294679:0:15138:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789115599.332570:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789115600.047659:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789115600.047665:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789115600.047668:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789115600.047671:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789115600.047673:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789115600.047676:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789115600.047680:0:8:0:(import.c:65:import_set_state_nolock()) ffff8dfcd1a61800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789115600.047691:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dfcd1a61800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1789115600.047714:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfbc2572580 x1876023308285824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789115600.047765:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91237388-4e21-4f8d-88fa-5d733c21b708:3305:1876023308285696:0@lo:400:kworker.0 00000100:00100000:0.0:1789115600.047835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115600.047910:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2572580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876023308285824:0@lo:38:kworker.0 00000100:00100000:0.0:1789115600.047940:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115600.047975:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308285696 00000100:00100000:0.0:1789115600.047984:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308285696 00000100:00100000:0.0:1789115600.048025:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789115600.048033:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+12:3305:x1876023308285696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115600.048079:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+12:3305:x1876023308285696:12345-0@lo:400:kworker.0 Request processed in 47us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115600.048086:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789115600.048138:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308285824 00000100:00100000:0.0:1789115600.048143:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308285824 00000100:00100000:0.0:1789115600.048161:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789115600.048166:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2573840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1876023308285824:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789115600.048186:0:14856:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:0.0:1789115600.048219:0:14856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa47abda6516d4255 00000004:00100000:0.0:1789115600.048234:0:14856:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789115600.048406:0:14856:0:(import.c:65:import_set_state_nolock()) ffff8dfcffb2d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789115600.048444:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2573840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876023308285824:12345-0@lo:38:kworker.0 Request processed in 277us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115600.048452:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789115600.048487:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91237388-4e21-4f8d-88fa-5d733c21b708:3305:1876023308285696:0@lo:400:kworker.0 00010000:00080000:0.0:1789115600.048518:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dfbc2572580 x1876023308285824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789115610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789115600.048531:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789115600.048538:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789115600.048542:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789115600.048555:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcd1a61800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789115600.048561:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2572580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876023308285824:0@lo:38:kworker.0 00010000:00010000:3.0:1789115600.356226:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115601.379555:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789115602.314488:0:15290:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffddf0c9260 20000000:00000080:1.0:1789115602.314507:0:15290:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dfcfb120c00 uarg=0000000000000000 20000000:01000000:1.0:1789115602.314549:0:15290:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789115602.314557:0:15290:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789115602.314562:0:15290:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789115602.315700:0:15291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1789115602.315843:0:15290:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789115602.322155:0:15290:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789115602.322187:0:15290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115602.322208:0:15290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcff9ea800/0xa47abda6516d421d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d4216 expref: 11 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115602.322217:0:15290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115602.322274:0:15290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcff9ea800/0xa47abda6516d421d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d4216 expref: 11 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115602.322290:0:15290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfcff9ea800/0xa47abda6516d421d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d4216 expref: 11 pid: 14848 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115602.322305:0:15290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15290:1876023308285952:0@lo:104: 00000100:00100000:1.0:1789115602.322373:0:15290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115602.322636:0:15290:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd88c0840 going to sleep for 11 seconds 00000100:00100000:2.0:1789115602.322892:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308285952 00000100:00100000:2.0:1789115602.322900:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308285952 00000100:00100000:2.0:1789115602.322951:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789115602.322960:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc330f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91237388-4e21-4f8d-88fa-5d733c21b708+3:15290:x1876023308285952:12345-0@lo:104: 00010000:00010000:2.0:1789115602.322973:0:14838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d421d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115602.323236:0:14838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789115602.323243:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc330f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91237388-4e21-4f8d-88fa-5d733c21b708+3:15290:x1876023308285952:12345-0@lo:104: Request processed in 284us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115602.323251:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789115602.323301:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115602.323308:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d421d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323316:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacca00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115602.323320:0:14843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d421d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323328:0:14843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d421d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115602.323335:0:14843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d421d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115602.323341:0:14843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789115602.323428:0:14843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d421d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323435:0:14843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115602.323453:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d421d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323460:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcedacca00/0xa47abda6516d4216 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d421d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323479:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115602.323481:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115602.323483:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115602.323558:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91237388-4e21-4f8d-88fa-5d733c21b708:3306:1876023308286080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789115602.323610:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115602.323742:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308286080 00000100:00100000:3.0:1789115602.323747:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308286080 00010000:00010000:3.0:1789115602.323770:0:14839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcff9ea800/0xa47abda6516d421d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d4216 expref: 12 pid: 14848 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115602.323802:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789115602.323809:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91237388-4e21-4f8d-88fa-5d733c21b708+12:3306:x1876023308286080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789115602.323820:0:14839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115602.323826:0:14839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcff9ea800/0xa47abda6516d421d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d4216 expref: 12 pid: 14848 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323837:0:14839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcff9ea800/0xa47abda6516d421d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d4216 expref: 12 pid: 14848 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323855:0:14839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323863:0:14839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323884:0:14839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323891:0:14839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323897:0:14839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323904:0:14839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323910:0:14839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6c00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115602.323913:0:14839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323920:0:14839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323929:0:14839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.323938:0:14839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115602.323979:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91237388-4e21-4f8d-88fa-5d733c21b708+12:3306:x1876023308286080:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115602.323985:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789115602.324056:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91237388-4e21-4f8d-88fa-5d733c21b708:3306:1876023308286080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789115602.324670:0:15290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcff9ea800/0xa47abda6516d421d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d4216 expref: 11 pid: 14848 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115602.324683:0:15290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15290:1876023308285952:0@lo:104: 00010000:00010000:1.0:1789115602.324699:0:15290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115602.324707:0:15290:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115602.324713:0:15290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115602.324719:0:15290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcedac6c00/0xa47abda6516d425c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115602.407771:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115603.428249:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789115603.749509:0:14851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789115603.749529:0:14851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcc5730000 from 13 10000000:01000000:2.0:1789115603.749537:0:14851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789115603.749621:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115603.749637:0:14851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115603.749651:0:14851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115603.749686:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308286208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789115603.749783:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115603.749855:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd90f69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115603.750276:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308286208 00000100:00100000:0.0:1789115603.750287:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308286208 00000100:00100000:0.0:1789115603.750359:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789115603.750448:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+11:14851:x1876023308286208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789115603.750468:0:14846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115603.750488:0:14846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfced9d3000/0xa47abda6516d426a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d4263 expref: -99 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115603.750532:0:14846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfced9d3000/0xa47abda6516d426a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d4263 expref: 12 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115603.750545:0:14846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfced9d3000/0xa47abda6516d426a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d4263 expref: 12 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115603.750555:0:14846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d3000, rc 0) 00000100:00100000:0.0:1789115603.750612:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+12:14851:x1876023308286208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 232us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115603.750620:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789115603.751048:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308286208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789115603.751068:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d426a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115603.751079:0:14851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d426a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115603.751156:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308286336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115603.751197:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115603.751230:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd90f69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115603.751248:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308286336 00000100:00100000:2.0:1789115603.751253:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308286336 00000100:00100000:2.0:1789115603.751282:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789115603.751289:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+12:14851:x1876023308286336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115603.751646:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+12:14851:x1876023308286336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 356us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115603.751664:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789115603.751706:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308286336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115603.751739:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308286464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115603.751787:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115603.751801:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd90f69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115603.751813:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308286464 00000100:00100000:2.0:1789115603.751817:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308286464 00000100:00100000:2.0:1789115603.751840:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789115603.751845:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1188050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+12:14851:x1876023308286464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115603.752010:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1188050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+12:14851:x1876023308286464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115603.752018:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789115603.752058:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308286464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789115603.752796:0:15347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789115603.752858:0:14851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789115603.752878:0:14851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789115603.752890:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d426a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115603.752901:0:14851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d426a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115604.132172:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789115594/real 1789115594] req@ffff8dfcfc331680 x1876023308283136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789115604 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115604.132213:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dfcfc331680 x1876023308283136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789115604 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115604.132236:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789115594/real 1789115594] req@ffff8dfcfc330000 x1876023308283008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789115604 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115604.132248:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dfcfc330000 x1876023308283008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789115604 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789115604.132264:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcc4f4f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789115604.132273:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789115604.132276:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc331680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308283136:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789115604.132282:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcc836c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789115604.132287:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789115604.132290:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308283008:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789115604.133827:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789115604.133834:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789115604.133848:0:8:0:(import.c:65:import_set_state_nolock()) ffff8dfcc836c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789115604.133855:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 411 00000100:00080000:3.0:1789115604.133859:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789115604.133866:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dfcc836c800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1789115604.133888:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfcfc098780 x1876023308286720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789115604.133904:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789115604.133907:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789115604.133908:0:8:0:(import.c:65:import_set_state_nolock()) ffff8dfcc4f4f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789115604.133911:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 411 00000100:00080000:3.0:1789115604.133913:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789115604.133916:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dfcc4f4f000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1789115604.133926:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfcfc09b0c0 x1876023308286848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789115604.133959:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc099a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91237388-4e21-4f8d-88fa-5d733c21b708:3307:1876023308286592:0@lo:400:kworker.0 00000100:00100000:3.0:1789115604.134034:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115604.134083:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115604.134095:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc098f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308286976:0@lo:400:kworker.0 00000100:00100000:3.0:1789115604.134123:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115604.134161:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308286592 00000100:00100000:3.0:1789115604.134168:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308286592 00000100:00100000:3.0:1789115604.134274:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789115604.134285:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+12:3307:x1876023308286592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115604.134337:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+12:3307:x1876023308286592:12345-0@lo:400:kworker.0 Request processed in 55us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115604.134353:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789115604.134420:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc099a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91237388-4e21-4f8d-88fa-5d733c21b708:3307:1876023308286592:0@lo:400:kworker.0 00000100:00100000:3.0:1789115604.134427:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308286976 00000100:00100000:3.0:1789115604.134432:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308286976 00000100:00100000:3.0:1789115604.134471:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789115604.134479:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc099e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308286976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115604.134561:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc098780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308286720:0@lo:8:kworker.0 00000400:00000100:2.0:1789115604.134588:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876023308286720 offset 0 length 520: 4 00000100:00100000:2.0:1789115604.134615:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308286848:0@lo:8:kworker.0 00000400:00000100:2.0:1789115604.134648:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876023308286848 offset 0 length 520: 4 00000100:00100000:3.0:1789115604.134670:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc099e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308286976:12345-0@lo:400:kworker.0 Request processed in 190us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115604.134678:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789115604.134705:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dfcfc098f00 x1876023308286976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115604.134718:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc098f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308286976:0@lo:400:kworker.0 00010000:00010000:2.0:1789115604.452291:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115605.476597:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115606.501331:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789115606.949484:0:14889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1789115607.354338:0:15539:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789115607.354342:0:15539:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789115607.354869:0:15539:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dfcc81ea800 00000020:01000004:3.0:1789115607.354962:0:15539:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789115607.354975:0:15539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789115607.355008:0:15539:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8dfcfbb01a48) 00000020:00000080:3.0:1789115607.355025:0:15539:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789115607.374174:0:15539:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789115607.374457:0:15539:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789115607.376170:0:15539:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789115607.376481:0:15539:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789115607.376713:0:15539:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789115607.377164:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 457: rc = 0 00100000:10000000:2.0:1789115607.377266:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 457: rc = 0 00100000:10000000:2.0:1789115607.377363:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 457: rc = 0 00100000:10000000:2.0:1789115607.377876:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 205: rc = 0 00100000:10000000:2.0:1789115607.378303:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 205: rc = 0 00100000:10000000:2.0:1789115607.378650:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 205: rc = 0 00100000:10000000:2.0:1789115607.378911:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 205: rc = 0 00100000:10000000:2.0:1789115607.379254:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 205: rc = 0 00100000:10000000:2.0:1789115607.379533:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 205: rc = 0 00000020:00000080:2.0:1789115607.380173:0:15539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789115607.380185:0:15539:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789115607.380195:0:15539:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa47abda6516d4278 00000020:01000004:2.0:1789115607.380204:0:15539:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789115607.380225:0:15539:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789115607.380229:0:15539:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789115607.380235:0:15539:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789115607.380246:0:15539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789115607.380258:0:15539:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8dfcd8a7b490) 00000020:00000080:2.0:1789115607.380268:0:15539:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789115607.381824:0:15539:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789115607.382009:0:15539:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789115607.382015:0:15539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789115607.390554:0:15539:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789115607.390665:0:15539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789115607.391541:0:15539:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789115607.391549:0:15539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789115607.392946:0:15539:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789115607.393292:0:15539:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789115607.393298:0:15539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789115607.393841:0:15539:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789115607.393848:0:15539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789115607.413322:0:15539:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789115607.413802:0:15539:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789115607.413810:0:15539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789115607.418177:0:15539:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789115607.418191:0:15539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789115607.419706:0:15539:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789115607.419718:0:15539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789115607.422629:0:15539:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789115607.422815:0:15539:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789115607.422821:0:15539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789115607.424129:0:15539:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789115607.424138:0:15539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789115607.466101:0:15539:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789115607.466288:0:15539:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789115607.466295:0:15539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789115607.467641:0:15539:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789115607.467651:0:15539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789115607.468030:0:15539:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789115607.468053:0:15539:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789115607.468060:0:15539:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789115607.477241:0:15539:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789115607.477278:0:15539:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789115607.477282:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789115607.477284:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789115607.477290:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115607.477291:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789115607.477292:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115607.477293:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115607.477295:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789115607.477296:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115607.477297:0:15539:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789115607.477300:0:15539:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789115607.477302:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789115607.477303:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789115607.477305:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115607.477305:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789115607.477306:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115607.477307:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115607.477308:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789115607.477309:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115607.477310:0:15539:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789115607.477334:0:15539:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789115607.477352:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5739a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308287104:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789115607.477492:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115607.477605:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc5674780 going to sleep for 11 seconds 00000100:00100000:1.0:1789115607.477692:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308287104 00000100:00100000:1.0:1789115607.477699:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308287104 00000100:00100000:1.0:1789115607.477812:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789115607.477822:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+12:15539:x1876023308287104:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789115607.477852:0:14849:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789115607.477855:0:14849:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789115607.477859:0:14849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789115607.484291:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+12:15539:x1876023308287104:12345-0@lo:253:mount.lustre.0 Request processed in 6461us (6789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115607.484307:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789115607.484482:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5739a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308287104:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789115607.484522:0:15539:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789115607.484526:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789115607.484527:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789115607.484529:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789115607.484530:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789115607.484531:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789115607.484532:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789115607.484533:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789115607.484535:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789115607.484537:0:15539:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789115607.484556:0:15539:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dfcc81ea800 from lustre-OST0000 10000000:01000000:1.0:1789115607.484583:0:15539:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789115607.484587:0:15539:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789115607.484593:0:15539:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dfcf5323490 local copy 00010000:00010000:1.0:1789115607.484605:0:15539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6a00/0xa47abda6516d416e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4175 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115607.485275:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308287232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115607.485324:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.485358:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee4119c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115607.485456:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308287232 00000100:00100000:2.0:1789115607.485463:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308287232 00000100:00100000:2.0:1789115607.485512:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789115607.485521:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+12:15539:x1876023308287232:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789115607.485689:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+12:15539:x1876023308287232:12345-0@lo:501:mount.lustre.0 Request processed in 168us (363us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789115607.485696:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789115607.485826:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308287232:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789115607.485841:0:15539:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789115607.486212:0:15539:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789115607.486221:0:15539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6a00/0xa47abda6516d416e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4175 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.486231:0:15539:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6a00/0xa47abda6516d416e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4175 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115607.486254:0:15539:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dfcc81ea800 10000000:01000000:1.0:1789115607.486264:0:15539:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789115607.486269:0:15539:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8dfcf5323490 10000000:01000000:1.0:1789115607.486272:0:15539:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789115607.486276:0:15539:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dfcf5323490 from 1 10000000:01000000:1.0:1789115607.486278:0:15539:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789115607.486307:0:15539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7800/0xa47abda6516d4286 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.486315:0:15539:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7800/0xa47abda6516d4286 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.486325:0:15539:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7800/0xa47abda6516d4286 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115607.486340:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308287360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789115607.486374:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.486489:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee4119c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115607.486687:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308287360 00000100:00100000:2.0:1789115607.486692:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308287360 00000100:00100000:2.0:1789115607.486770:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789115607.486778:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+12:15539:x1876023308287360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789115607.486789:0:14849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115607.486803:0:14849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedacda00/0xa47abda6516d428d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d4286 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115607.486822:0:14849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedacda00/0xa47abda6516d428d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d4286 expref: 13 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115607.486833:0:14849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedacda00/0xa47abda6516d428d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d4286 expref: 13 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115607.486842:0:14849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacda00, rc 0) 00000100:00100000:2.0:1789115607.486893:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+13:15539:x1876023308287360:12345-0@lo:101:mount.lustre.0 Request processed in 117us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115607.486900:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789115607.486965:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308287360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789115607.486989:0:15539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7800/0xa47abda6516d4286 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d428d expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.486998:0:15539:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7800/0xa47abda6516d4286 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d428d expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115607.487015:0:15539:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789115607.487040:0:15539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7800/0xa47abda6516d4286 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d428d expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.487049:0:15539:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7800/0xa47abda6516d4286 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d428d expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115607.487066:0:15539:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789115607.487070:0:15539:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789115607.487075:0:15539:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789115607.487078:0:15539:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789115607.487094:0:15539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d4294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.487101:0:15539:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d4294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.487108:0:15539:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d4294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115607.487122:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308287488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789115607.487149:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.487526:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee4119c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115607.487590:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308287488 00000100:00100000:0.0:1789115607.487596:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308287488 00000100:00100000:0.0:1789115607.487621:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789115607.487628:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+13:15539:x1876023308287488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789115607.487636:0:14846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115607.487646:0:14846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfced9d2200/0xa47abda6516d429b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d4294 expref: -99 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.487662:0:14846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfced9d2200/0xa47abda6516d429b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d4294 expref: 14 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.487670:0:14846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfced9d2200/0xa47abda6516d429b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d4294 expref: 14 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.487683:0:14846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d2200, rc 0) 00000100:00100000:0.0:1789115607.487726:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+14:15539:x1876023308287488:12345-0@lo:101:mount.lustre.0 Request processed in 98us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115607.487732:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789115607.487804:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308287488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789115607.487816:0:15539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d4294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d429b expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.487824:0:15539:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d4294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d429b expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789115607.488654:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789115607.489653:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789115607.490005:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789115607.490123:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789115607.490159:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789115607.490219:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789115607.490255:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789115607.490288:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789115607.490363:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789115607.490372:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789115607.490483:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308287616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115607.490558:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.490592:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee4110c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115607.490748:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308287616 00000100:00100000:2.0:1789115607.490756:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308287616 00000100:00100000:2.0:1789115607.490796:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789115607.490805:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+14:15539:x1876023308287616:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789115607.491334:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+14:15539:x1876023308287616:12345-0@lo:501:mount.lustre.0 Request processed in 529us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115607.491342:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789115607.491558:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308287616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115607.491597:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308287744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789115607.491639:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.491670:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee4110c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115607.491733:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308287744 00000100:00100000:2.0:1789115607.491738:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308287744 00000100:00100000:2.0:1789115607.491769:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789115607.491776:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+14:15539:x1876023308287744:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789115607.492316:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+14:15539:x1876023308287744:12345-0@lo:503:mount.lustre.0 Request processed in 539us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115607.492329:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789115607.492492:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308287744:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789115607.493333:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789115607.495143:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308287872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789115607.495234:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.495453:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee4110c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789115607.495788:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308287872 00000100:00100000:3.0:1789115607.495796:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308287872 00000100:00100000:2.0:1789115607.496127:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789115607.496138:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+14:15539:x1876023308287872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789115607.496506:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+14:15539:x1876023308287872:12345-0@lo:502:mount.lustre.0 Request processed in 360us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115607.496514:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789115607.496664:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308287872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789115607.496935:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789115607.496999:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789115607.497119:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789115607.497172:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789115607.497211:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789115607.497245:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789115607.497295:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789115607.497331:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789115607.497364:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789115607.497616:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789115607.497654:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789115607.497699:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789115607.497741:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789115607.497802:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115607.497940:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc89803c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115607.498144:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308288000 00000100:00100000:2.0:1789115607.498152:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308288000 00000100:00100000:2.0:1789115607.498226:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789115607.498236:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+14:15539:x1876023308288000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789115607.498432:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+14:15539:x1876023308288000:12345-0@lo:502:mount.lustre.0 Request processed in 197us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115607.498438:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789115607.498527:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789115607.498601:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789115607.498611:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789115607.502358:0:15553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789115607.502369:0:15553:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789115607.502376:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115607.502378:0:15553:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789115607.502411:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789115607.502424:0:15553:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8dfcd8a7ced8) 00000020:00000080:2.0:1789115607.502443:0:15553:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789115607.502447:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789115607.502535:0:15553:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dfcc81ea800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789115607.502543:0:15553:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789115607.502550:0:15553:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa47abda6516d42a9 00010000:00010000:2.0:1789115607.507102:0:15553:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789115607.507828:0:15553:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1789115607.518601:0:15553:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1789115607.534807:0:15553:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789115607.534821:0:15553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115607.534827:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115607.534830:0:15553:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789115607.534835:0:15553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789115607.534838:0:15553:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789115607.534840:0:15553:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789115607.534841:0:15553:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789115607.534842:0:15553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789115607.534845:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115607.534846:0:15553:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789115607.534848:0:15553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115607.534861:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115607.534862:0:15553:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789115607.534866:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789115607.534868:0:15553:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789115607.534871:0:15553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115607.534873:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115607.534886:0:15553:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789115607.534890:0:15553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115607.534893:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115607.534894:0:15553:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789115607.534897:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789115607.534935:0:15553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115607.534938:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115607.534940:0:15553:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789115607.534943:0:15553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00010000:00010000:3.0:1789115607.535296:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789115607.535359:0:15539:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789115607.535491:0:15539:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789115607.535856:0:15539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d4294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d429b expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.535871:0:15539:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6600/0xa47abda6516d4294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d429b expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115607.535997:0:15539:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcc81ea800 from 1 10000000:01000000:1.0:1789115607.536002:0:15539:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789115607.536169:0:15539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.536177:0:15539:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.536188:0:15539:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115607.536212:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789115607.536276:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.536321:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411000 going to sleep for 11 seconds 00000100:00100000:2.0:1789115607.537523:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308288128 00000100:00100000:2.0:1789115607.537543:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308288128 00000100:00100000:2.0:1789115607.537599:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789115607.537609:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+14:15539:x1876023308288128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789115607.537625:0:14849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115607.537641:0:14849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedacd800/0xa47abda6516d42b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d42b0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115607.537667:0:14849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedacd800/0xa47abda6516d42b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d42b0 expref: 15 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115607.537677:0:14849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedacd800/0xa47abda6516d42b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d42b0 expref: 15 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115607.537685:0:14849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacd800, rc 0) 00000100:00100000:2.0:1789115607.537756:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+15:15539:x1876023308288128:12345-0@lo:101:mount.lustre.0 Request processed in 149us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115607.537763:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789115607.538096:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789115607.538116:0:15539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d42b7 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.538136:0:15539:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d42b7 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789115607.538672:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789115607.542509:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789115607.542831:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789115607.542892:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789115607.542954:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789115607.542962:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789115607.544177:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115607.544244:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.544289:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411000 going to sleep for 11 seconds 00000100:00100000:0.0:1789115607.545214:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308288256 00000100:00100000:0.0:1789115607.545225:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308288256 00000100:00100000:0.0:1789115607.545279:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789115607.545289:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+15:15539:x1876023308288256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789115607.545586:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+15:15539:x1876023308288256:12345-0@lo:501:mount.lustre.0 Request processed in 298us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115607.545595:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789115607.546197:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115607.546245:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789115607.546298:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.546691:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411000 going to sleep for 11 seconds 00000100:00100000:2.0:1789115607.550043:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308288384 00000100:00100000:2.0:1789115607.550058:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308288384 00000100:00100000:2.0:1789115607.550111:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789115607.550120:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+15:15539:x1876023308288384:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789115607.550368:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+15:15539:x1876023308288384:12345-0@lo:503:mount.lustre.0 Request processed in 248us (4069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115607.550377:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789115607.550616:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288384:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789115607.551289:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789115607.551366:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789115607.551460:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.551491:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411000 going to sleep for 11 seconds 00000100:00100000:0.0:1789115607.551562:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308288512 00000100:00100000:0.0:1789115607.551567:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308288512 00000100:00100000:0.0:1789115607.551597:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789115607.551604:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+15:15539:x1876023308288512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789115607.551759:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+15:15539:x1876023308288512:12345-0@lo:502:mount.lustre.0 Request processed in 155us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115607.551766:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789115607.551848:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789115607.552226:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789115607.552274:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789115607.552350:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789115607.552435:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789115607.552474:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789115607.552538:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789115607.552576:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789115607.552608:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:1.0:1789115607.552652:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:1.0:1789115607.552688:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:1.0:1789115607.552736:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:1.0:1789115607.552770:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789115607.552823:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.552849:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411000 going to sleep for 11 seconds 00000100:00100000:3.0:1789115607.552929:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308288640 00000100:00100000:3.0:1789115607.552936:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308288640 00000100:00100000:3.0:1789115607.552962:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789115607.552970:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+15:15539:x1876023308288640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789115607.553150:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+15:15539:x1876023308288640:12345-0@lo:502:mount.lustre.0 Request processed in 180us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115607.553158:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789115607.553997:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789115607.554098:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:1.0:1789115607.554111:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789115607.555288:0:15557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789115607.555299:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115607.555301:0:15557:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789115607.555308:0:15557:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dfcc81ea800 00000020:00000080:2.0:1789115607.555310:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789115607.555323:0:15557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115607.555326:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115607.555327:0:15557:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789115607.555329:0:15557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789115607.555332:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115607.555333:0:15557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789115607.555337:0:15557:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dfcc81ea800 00000020:00000080:2.0:1789115607.555339:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789115607.555421:0:15557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115607.555425:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115607.555426:0:15557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789115607.555428:0:15557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789115607.555430:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115607.555431:0:15557:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789115607.555435:0:15557:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dfcc81ea800 00000020:00000080:2.0:1789115607.555437:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789115607.555453:0:15557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115607.555455:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115607.555457:0:15557:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789115607.555459:0:15557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789115607.555461:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115607.555462:0:15557:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789115607.555465:0:15557:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dfcc81ea800 00000020:00000080:2.0:1789115607.555466:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789115607.555522:0:15557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789115607.555526:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789115607.555528:0:15557:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789115607.555531:0:15557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789115607.561820:0:15539:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789115607.561865:0:15539:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789115607.561889:0:15539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d42b7 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.561902:0:15539:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d42b7 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115607.561955:0:15539:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789115607.561958:0:15539:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dfcc81ea800 10000000:01000000:1.0:1789115607.561961:0:15539:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dfcc81ea800 10000000:01000000:1.0:1789115607.561965:0:15539:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789115607.561970:0:15539:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dfcc81ea800 from 1 10000000:01000000:1.0:1789115607.561984:0:15539:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789115607.562021:0:15539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d42be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.562045:0:15539:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d42be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.562058:0:15539:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d42be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115607.562082:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288768:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789115607.562150:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.562192:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411000 going to sleep for 11 seconds 00000100:00100000:2.0:1789115607.562624:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308288768 00000100:00100000:2.0:1789115607.562632:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308288768 00000100:00100000:2.0:1789115607.562733:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789115607.562743:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+15:15539:x1876023308288768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789115607.562757:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115607.562776:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedacde00/0xa47abda6516d42c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d42be expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115607.562799:0:14848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedacde00/0xa47abda6516d42c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d42be expref: 16 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115607.562809:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedacde00/0xa47abda6516d42c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d42be expref: 16 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115607.562818:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedacde00, rc 0) 00000100:00100000:2.0:1789115607.562868:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+16:15539:x1876023308288768:12345-0@lo:101:mount.lustre.0 Request processed in 126us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115607.562886:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789115607.562983:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789115607.562997:0:15539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d42be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d42c5 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.563007:0:15539:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d42be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d42c5 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789115607.568646:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789115607.569442:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789115607.569746:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789115607.569788:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789115607.571522:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789115607.571647:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789115607.571687:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789115607.571736:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789115607.571773:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789115607.571803:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789115607.572590:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789115607.572631:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789115607.572671:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789115607.572711:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789115607.572740:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789115607.572767:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789115607.572804:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789115607.573522:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789115607.573563:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789115607.573618:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789115607.573653:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789115607.573702:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789115607.573752:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789115607.573787:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789115607.577437:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789115607.577633:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789115607.577673:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789115607.577707:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789115607.577754:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789115607.577791:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789115607.578144:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789115607.578546:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789115607.578641:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115607.578704:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.578745:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411000 going to sleep for 11 seconds 00000100:00100000:2.0:1789115607.581485:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308288896 00000100:00100000:2.0:1789115607.581508:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308288896 00000100:00100000:2.0:1789115607.581569:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789115607.581578:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+16:15539:x1876023308288896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789115607.581873:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+16:15539:x1876023308288896:12345-0@lo:501:mount.lustre.0 Request processed in 295us (3168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115607.582170:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789115607.584569:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308288896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115607.584627:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308289024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789115607.584696:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115607.584726:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308289024 00000100:00100000:2.0:1789115607.584732:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308289024 00000100:00100000:1.0:1789115607.584735:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411000 going to sleep for 11 seconds 00000100:00100000:2.0:1789115607.584770:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789115607.584779:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+16:15539:x1876023308289024:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789115607.585204:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+16:15539:x1876023308289024:12345-0@lo:503:mount.lustre.0 Request processed in 425us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115607.585213:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789115607.585874:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308289024:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789115607.586440:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789115607.586530:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308289152:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789115607.586588:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.586628:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411000 going to sleep for 11 seconds 00000100:00100000:2.0:1789115607.586731:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308289152 00000100:00100000:2.0:1789115607.586743:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308289152 00000100:00100000:2.0:1789115607.586778:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789115607.586786:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+16:15539:x1876023308289152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789115607.587223:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+16:15539:x1876023308289152:12345-0@lo:502:mount.lustre.0 Request processed in 437us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115607.587232:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789115607.588707:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308289152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789115607.589020:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789115607.589083:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789115607.589119:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789115607.589195:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789115607.589420:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789115607.589475:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789115607.589925:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789115607.589959:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789115607.590009:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789115607.590045:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789115607.590071:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789115607.590112:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789115607.590139:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789115607.590168:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789115607.590305:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789115607.590348:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789115607.590430:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789115607.590484:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789115607.590535:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789115607.590585:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789115607.590635:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789115607.590672:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789115607.590705:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789115607.590752:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789115607.590788:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789115607.592193:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789115607.592698:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789115607.592744:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789115607.592777:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789115607.592838:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789115607.592873:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789115607.592905:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789115607.592938:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789115607.592988:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789115607.593024:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789115607.593089:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789115607.593127:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789115607.593162:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789115607.593352:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789115607.593417:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789115607.593466:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308289280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789115607.593552:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.593593:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411000 going to sleep for 11 seconds 00000100:00100000:2.0:1789115607.594001:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308289280 00000100:00100000:2.0:1789115607.594009:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308289280 00000100:00100000:2.0:1789115607.594070:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789115607.594080:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+16:15539:x1876023308289280:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789115607.594305:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+16:15539:x1876023308289280:12345-0@lo:502:mount.lustre.0 Request processed in 225us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115607.594313:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789115607.594941:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308289280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789115607.595045:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789115607.595057:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789115607.598601:0:15563:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789115607.598619:0:15563:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8dfcd8a79a48) 00000020:00000080:2.0:1789115607.598638:0:15563:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789115607.598705:0:15563:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dfcc81ea800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789115607.598710:0:15563:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dfcc81ea800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789115607.598712:0:15563:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dfcc81ea800 3 00010000:00080000:2.0:1789115607.598742:0:15563:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dfce2b06000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1789115607.602778:0:15563:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1789115607.602984:0:15563:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789115607.603018:0:15563:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789115607.603029:0:15563:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa47abda6516d42d3 00000100:00080000:2.0:1789115607.603039:0:15563:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789115607.603045:0:15563:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dfce2b06000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1789115607.603081:0:15563:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfcc57383c0 x1876023308289408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789115607.603134:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc57383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876023308289408:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789115607.603204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115607.603276:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308289408 00000100:00100000:2.0:1789115607.603283:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308289408 00000100:00100000:2.0:1789115607.603314:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789115607.603321:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876023308289408:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789115607.603343:0:14854:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:2.0:1789115607.603377:0:14854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa47abda6516d42da 00000004:00100000:2.0:1789115607.603411:0:14854:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789115607.603440:0:14854:0:(import.c:65:import_set_state_nolock()) ffff8dfcf5328000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789115607.603488:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876023308289408:12345-0@lo:38:llog_process_th.0 Request processed in 165us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115607.604689:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789115607.604745:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcc57383c0 x1876023308289408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789115617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115607.604756:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789115607.604764:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789115607.604771:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789115607.604775:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789115607.604778:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfce2b06000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789115607.604784:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc57383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876023308289408:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789115607.604804:0:15563:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1789115607.606652:0:15563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:0.0:1789115607.607724:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789115607.607730:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789115607.607732:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789115607.607735:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789115607.607795:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2571e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308289536:0@lo:400:kworker.0 00000100:00100000:0.0:1789115607.607856:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1789115607.608471:0:15539:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789115607.608509:0:15539:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789115607.608525:0:15539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d42be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d42c5 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.608537:0:15539:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedac7000/0xa47abda6516d42be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d42c5 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789115607.608590:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789115607.608592:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789115607.608593:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789115607.608598:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789115607.608599:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789115607.608600:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789115607.608602:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789115607.608603:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789115607.608605:0:15539:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789115607.608609:0:15539:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789115607.608611:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789115607.608612:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789115607.608613:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789115607.608614:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789115607.608615:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789115607.608616:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789115607.608617:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789115607.608618:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789115607.608618:0:15539:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789115607.608637:0:15539:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789115607.608648:0:15539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308289664:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789115607.608690:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.608717:0:15539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789115607.609156:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308289536 00000100:00100000:0.0:1789115607.609163:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308289536 00000100:00100000:0.0:1789115607.609214:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789115607.609223:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2572d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308289536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115607.609278:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2572d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308289536:12345-0@lo:400:kworker.0 Request processed in 56us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115607.609286:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789115607.609323:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfbc2571e00 x1876023308289536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115607.609336:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2571e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308289536:0@lo:400:kworker.0 00000100:00100000:2.0:1789115607.611228:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308289664 00000100:00100000:2.0:1789115607.611249:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308289664 00000100:00100000:2.0:1789115607.611334:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789115607.611344:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+16:15539:x1876023308289664:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789115607.611373:0:14848:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789115607.611407:0:14848:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789115607.646821:0:14848:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789115607.646837:0:14848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789115607.646901:0:14870:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789115607.646906:0:14870:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789115607.646925:0:14870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.646943:0:14870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d424e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d4247 expref: 16 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.646951:0:14870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.646997:0:14870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d424e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d4247 expref: 16 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115607.647011:0:14870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d424e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d4247 expref: 16 pid: 14848 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115607.647043:0:14870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc331e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14870:1876023308289792:0@lo:104: 00000100:00100000:1.0:1789115607.647104:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115607.647148:0:14870:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789115607.648739:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308289792 00000100:00100000:0.0:1789115607.648750:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308289792 00000100:00100000:0.0:1789115607.648798:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789115607.648807:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc330780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91237388-4e21-4f8d-88fa-5d733c21b708+3:14870:x1876023308289792:12345-0@lo:104: 00010000:00010000:0.0:1789115607.648823:0:14837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d424e expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.648915:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789115607.648934:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc330780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91237388-4e21-4f8d-88fa-5d733c21b708+3:14870:x1876023308289792:12345-0@lo:104: Request processed in 129us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115607.648942:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789115607.648966:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115607.648982:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d424e expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.648990:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3e00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:0.0:1789115607.648994:0:14842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d424e expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649003:0:14842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d424e expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789115607.649011:0:14842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d424e expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789115607.649017:0:14842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789115607.649052:0:14842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d424e expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649059:0:14842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789115607.649076:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d424e expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649082:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d4247 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d424e expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649096:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115607.649097:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115607.649099:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115607.649119:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2571e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91237388-4e21-4f8d-88fa-5d733c21b708:3306:1876023308289920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789115607.649154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115607.649204:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308289920 00000100:00100000:0.0:1789115607.649208:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308289920 00010000:00010000:0.0:1789115607.649225:0:14841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d424e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d4247 expref: 17 pid: 14848 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115607.649247:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789115607.649253:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc25703c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91237388-4e21-4f8d-88fa-5d733c21b708+17:3306:x1876023308289920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789115607.649264:0:14841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115607.649270:0:14841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d424e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d4247 expref: 17 pid: 14848 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649280:0:14841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d424e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d4247 expref: 17 pid: 14848 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649296:0:14841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649304:0:14841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789115607.649318:0:14841:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002412921s 00010000:00010000:0.0:1789115607.649322:0:14841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649328:0:14841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649335:0:14841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649352:0:14841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649358:0:14841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115607.649361:0:14841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649369:0:14841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649378:0:14841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649422:0:14841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115607.649451:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc25703c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91237388-4e21-4f8d-88fa-5d733c21b708+17:3306:x1876023308289920:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115607.649458:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789115607.649491:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2571e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91237388-4e21-4f8d-88fa-5d733c21b708:3306:1876023308289920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789115607.649543:0:14870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d424e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d4247 expref: 16 pid: 14848 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115607.649553:0:14870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc331e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14870:1876023308289792:0@lo:104: 00010000:00010000:0.0:1789115607.649566:0:14870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649574:0:14870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649590:0:14870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115607.649596:0:14870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcedac6000/0xa47abda6516d42e1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115607.655990:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+15:15539:x1876023308289664:12345-0@lo:253:mount.lustre.0 Request processed in 44639us (47289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115607.656004:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789115607.656164:0:15539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:15539:1876023308289664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789115607.656181:0:15539:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789115607.656185:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789115607.656186:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789115607.656188:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115607.656189:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789115607.656190:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115607.656191:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115607.656193:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789115607.656194:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115607.656196:0:15539:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789115607.656209:0:15539:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789115607.661186:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789115607.661360:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789115607.661847:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789115607.662160:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789115607.662359:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789115607.662607:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789115607.663770:0:15539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789115607.723192:0:15539:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789115607.723200:0:15539:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789115607.723234:0:15539:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789115607.723295:0:15539:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789115607.723311:0:15539:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789115607.723339:0:15539:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789115608.548524:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789115609.123929:0:14851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789115609.123937:0:14851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dfcc5730000 from 7 10000000:01000000:0.0:1789115609.123942:0:14851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789115609.123987:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115609.123999:0:14851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115609.124011:0:14851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115609.124046:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2570b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308290048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789115609.124124:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115609.124175:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1158f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789115609.124210:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308290048 00000100:00100000:3.0:1789115609.124217:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308290048 00000100:00100000:3.0:1789115609.124319:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789115609.124331:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+15:14851:x1876023308290048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115609.124358:0:14846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115609.124371:0:14846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d42ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d42e8 expref: -99 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115609.124575:0:14846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d42ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d42e8 expref: 16 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115609.124587:0:14846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d42ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d42e8 expref: 16 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115609.124597:0:14846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eaa00, rc 0) 00000100:00100000:3.0:1789115609.124642:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+16:14851:x1876023308290048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 313us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115609.132863:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2570b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308290048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789115609.132892:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d42ef expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115609.132922:0:14851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d42ef expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115609.132990:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2570b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308290176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789115609.133184:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115609.133219:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1158f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789115609.133238:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308290176 00000100:00100000:0.0:1789115609.133244:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308290176 00000100:00100000:0.0:1789115609.133281:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789115609.133291:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+17:14851:x1876023308290176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789115609.133311:0:14848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789115609.133330:0:14848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789115609.133334:0:14848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789115609.133436:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+17:14851:x1876023308290176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115609.133444:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789115609.133479:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2570b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308290176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789115609.133545:0:14851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789115609.133553:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d42ef expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115609.133562:0:14851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d42ef expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115609.135130:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1789115609.576462:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115610.597252:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115611.623161:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115612.643673:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789115612.843708:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789115612.843715:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789115612.843717:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789115612.843720:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789115612.843769:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308290560:0@lo:400:kworker.0 00000100:00100000:1.0:1789115612.843840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115612.844500:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91237388-4e21-4f8d-88fa-5d733c21b708:3307:1876023308290304:0@lo:400:kworker.0 00000100:00100000:3.0:1789115612.844544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115612.844574:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789115612.844581:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc333840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308290432:0@lo:400:kworker.0 00000100:00100000:3.0:1789115612.844605:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115612.844644:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308290560 00000100:00100000:3.0:1789115612.844650:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308290560 00000100:00100000:3.0:1789115612.844705:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308290432 00000100:00100000:3.0:1789115612.844709:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308290432 00000100:00100000:3.0:1789115612.844726:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789115612.844733:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc331a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308290560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115612.844833:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc331a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308290560:12345-0@lo:400:kworker.0 Request processed in 99us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115612.844848:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789115612.844866:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789115612.844872:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc0992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308290432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115612.844906:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc0992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308290432:12345-0@lo:400:kworker.0 Request processed in 34us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115612.844911:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789115612.844965:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcfc330b40 x1876023308290560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115612.844980:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308290560:0@lo:400:kworker.0 00010000:00080000:3.0:1789115612.845012:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcfc333840 x1876023308290432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115612.845022:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc333840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308290432:0@lo:400:kworker.0 00000100:00100000:1.0:1789115612.845090:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308290304 00000100:00100000:1.0:1789115612.845094:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308290304 00000100:00100000:1.0:1789115612.845128:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789115612.845135:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+16:3307:x1876023308290304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115612.845172:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+16:3307:x1876023308290304:12345-0@lo:400:kworker.0 Request processed in 38us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115612.845178:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789115612.848192:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91237388-4e21-4f8d-88fa-5d733c21b708:3307:1876023308290304:0@lo:400:kworker.0 00000100:00080000:3.0:1789115612.848863:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789115613.667580:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789115614.010260:0:15907:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789115614.691603:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115615.717302:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789115616.164086:0:14889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789115616.739523:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115617.763797:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789115617.956654:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789115617.956661:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789115617.956664:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789115617.956861:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91237388-4e21-4f8d-88fa-5d733c21b708:3306:1876023308290688:0@lo:400:kworker.0 00000100:00100000:0.0:1789115617.956974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115617.957152:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308290688 00000100:00100000:3.0:1789115617.957163:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308290688 00000100:00100000:3.0:1789115617.957235:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789115617.957248:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+16:3306:x1876023308290688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115617.957328:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+16:3306:x1876023308290688:12345-0@lo:400:kworker.0 Request processed in 83us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115617.957338:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789115617.957905:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789115617.958002:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308290816:0@lo:400:kworker.0 00000100:00100000:2.0:1789115617.958051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115617.958095:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789115617.958101:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308290944:0@lo:400:kworker.0 00000100:00100000:2.0:1789115617.958126:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115617.958164:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308290816 00000100:00100000:2.0:1789115617.958170:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308290816 00000100:00100000:2.0:1789115617.958210:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308290944 00000100:00100000:2.0:1789115617.958213:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308290944 00000100:00100000:2.0:1789115617.958241:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789115617.958247:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc57392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308290816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115617.958293:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc57392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308290816:12345-0@lo:400:kworker.0 Request processed in 45us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115617.958300:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789115617.958314:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789115617.958319:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308290944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115617.958358:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308290944:12345-0@lo:400:kworker.0 Request processed in 38us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115617.958365:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789115617.958434:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcc573b840 x1876023308290944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115617.958449:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308290944:0@lo:400:kworker.0 00010000:00080000:2.0:1789115617.958464:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcc573a1c0 x1876023308290816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789115617.959257:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91237388-4e21-4f8d-88fa-5d733c21b708:3306:1876023308290688:0@lo:400:kworker.0 00000100:00080000:3.0:1789115617.959315:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115617.960588:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308290816:0@lo:400:kworker.0 00010000:00010000:1.0:1789115618.798893:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115619.811552:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115619.875581:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789115604/real 1789115604] req@ffff8dfcfc098780 x1876023308286720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789115619 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115619.875630:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dfcfc098780 x1876023308286720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789115619 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115619.875641:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789115604/real 1789115604] req@ffff8dfcfc09b0c0 x1876023308286848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789115619 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115619.875652:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dfcfc09b0c0 x1876023308286848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789115619 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789115619.875669:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcc836c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789115619.875689:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789115619.875693:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc098780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308286720:0@lo:8:kworker.0 00000100:00080000:2.0:1789115619.875699:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcc4f4f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789115619.875704:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789115619.875707:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308286848:0@lo:8:kworker.0 00000100:00080000:0.0:1789115619.875963:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789115619.875968:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789115619.875971:0:8:0:(import.c:65:import_set_state_nolock()) ffff8dfcc836c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789115619.875976:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 421 00000100:00080000:0.0:1789115619.875981:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789115619.875987:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dfcc836c800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1789115619.876007:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfbc2573c00 x1876023308291200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789115619.876028:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789115619.876031:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789115619.876032:0:8:0:(import.c:65:import_set_state_nolock()) ffff8dfcc4f4f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789115619.876035:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 421 00000100:00080000:0.0:1789115619.876038:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789115619.876042:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dfcc4f4f000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1789115619.876054:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfbc2570b40 x1876023308291328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789115619.876103:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2571e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308291584:0@lo:400:kworker.0 00000100:00100000:0.0:1789115619.876170:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115619.876242:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308291584 00000100:00100000:0.0:1789115619.876256:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308291584 00000100:00100000:0.0:1789115619.876313:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789115619.876321:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc25721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308291584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115619.876371:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc25721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308291584:12345-0@lo:400:kworker.0 Request processed in 50us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115619.876378:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789115619.876567:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2573c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308291200:0@lo:8:kworker.0 00000100:00100000:2.0:1789115619.876599:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115619.876625:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2570b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308291328:0@lo:8:kworker.0 00000100:00100000:2.0:1789115619.876646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115619.876717:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc25712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308291456:0@lo:400:kworker.0 00000100:00100000:1.0:1789115619.876750:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115619.876782:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789115619.876788:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91237388-4e21-4f8d-88fa-5d733c21b708:3306:1876023308291072:0@lo:400:kworker.0 00000100:00100000:1.0:1789115619.876812:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115619.876884:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308291456 00000100:00100000:2.0:1789115619.876897:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308291456 00000100:00100000:2.0:1789115619.876920:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789115619.876926:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308291456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115619.876976:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876023308291456:12345-0@lo:400:kworker.0 Request processed in 49us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115619.876983:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789115619.877034:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115619.877054:0:15540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308291200 00000100:00100000:0.0:1789115619.877058:0:15540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308291200 00010000:00080000:1.0:1789115619.877106:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfbc25712c0 x1876023308291456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115619.877121:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc25712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876023308291456:0@lo:400:kworker.0 00000100:00100000:0.0:1789115619.877285:0:15540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308291328 00000100:00100000:0.0:1789115619.877290:0:15540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308291328 00000100:00100000:2.0:1789115619.877295:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789115619.877300:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1876023308291200:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789115619.877325:0:15543:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:2.0:1789115619.877353:0:15543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa47abda6516d42f6 00002000:00100000:2.0:1789115619.877367:0:15543:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dfcf532d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398e ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789115619.877371:0:15543:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789115619.877373:0:15543:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789115619.877821:0:15543:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789115619.877846:0:15543:0:(import.c:65:import_set_state_nolock()) ffff8dfcf532a000 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1789115619.877903:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfbc2571e00 x1876023308291584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115619.877914:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2571e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308291584:0@lo:400:kworker.0 00000100:00100000:3.0:1789115619.877979:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308291072 00000100:00100000:3.0:1789115619.877984:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308291072 00000100:00100000:3.0:1789115619.878025:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789115619.878033:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+16:3306:x1876023308291072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115619.878064:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876023308291200:12345-0@lo:8:kworker.0 Request processed in 762us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115619.878072:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+16:3306:x1876023308291072:12345-0@lo:400:kworker.0 Request processed in 41us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115619.878072:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789115619.878078:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789115619.878114:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91237388-4e21-4f8d-88fa-5d733c21b708:3306:1876023308291072:0@lo:400:kworker.0 00010000:00080000:1.0:1789115619.878185:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfbc2573c00 x1876023308291200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789115639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115619.878194:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789115619.878201:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789115619.878208:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789115619.878212:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789115619.878215:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcc836c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789115619.878229:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789115619.878234:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2573c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308291200:0@lo:8:kworker.0 00000100:00100000:0.0:1789115619.878395:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc098b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308291712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789115619.878469:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789115619.878474:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5739680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1876023308291328:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789115619.878487:0:15543:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789115619.878546:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115619.878595:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5739680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1876023308291328:12345-0@lo:8:kworker.0 Request processed in 119us (1947us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789115619.878601:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789115619.878610:0:15544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308291712 00000100:00100000:1.0:1789115619.878613:0:15544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308291712 00000100:00080000:2.0:1789115619.878636:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789115619.878646:0:15544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789115619.878653:0:15544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2571e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308291712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789115619.878675:0:15544:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000004:00080000:3.0:1789115619.878735:0:14877:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1789115619.878755:0:14877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc0983c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14877:1876023308291840:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789115619.878782:0:14877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115619.878798:0:14877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411240 going to sleep for 11 seconds 00000100:00100000:2.0:1789115619.878801:0:15540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308291840 00000100:00100000:2.0:1789115619.878805:0:15540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308291840 00000004:00080000:3.0:1789115619.878812:0:14876:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789115619.878907:0:15540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789115619.878914:0:15540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc098f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14877:x1876023308291840:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789115619.879213:0:14876:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437091829778ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789115619.880138:0:15544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2571e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876023308291712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1481us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115619.880149:0:15544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789115619.880204:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcc4f4f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789115619.880209:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789115619.880213:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2570b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308291328:0@lo:8:kworker.0 00010000:00080000:0.0:1789115619.880286:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcfc098b40 x1876023308291712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115619.880307:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc098b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308291712:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1789115619.887490:0:15540:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789115619.887500:0:15540:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789115619.887506:0:15540:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1789115619.893855:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.893866:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000938762de/0xa47abda6516d42fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.893884:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.893888:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.894016:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000938762de/0xa47abda6516d42fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.894035:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000938762de/0xa47abda6516d42fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.894045:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000938762de/0xa47abda6516d42fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.894053:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000938762de/0xa47abda6516d42fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.894072:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789115619.896259:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.896272:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d590aadf/0xa47abda6516d4304 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.896288:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.896292:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.896298:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d590aadf/0xa47abda6516d4304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.896323:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d590aadf/0xa47abda6516d4304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.896334:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d590aadf/0xa47abda6516d4304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.896341:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d590aadf/0xa47abda6516d4304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.896362:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789115619.896374:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789115619.896400:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000938762de/0xa47abda6516d42fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.897310:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc600 already unused, calling callback (ffffffffc1728550) 00010000:00010000:2.0:1789115619.897321:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000938762de/0xa47abda6516d42fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.897334:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000938762de/0xa47abda6516d42fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.897352:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000938762de/0xa47abda6516d42fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.897359:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000938762de/0xa47abda6516d42fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.897667:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789115619.898936:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115619.898941:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115619.898943:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.899887:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.899897:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcd5f0d/0xa47abda6516d430b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.899912:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.899916:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.899923:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bcd5f0d/0xa47abda6516d430b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.899936:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bcd5f0d/0xa47abda6516d430b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.899945:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcd5f0d/0xa47abda6516d430b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.899952:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bcd5f0d/0xa47abda6516d430b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.899976:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789115619.900374:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.900406:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d4312 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.900439:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.900442:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.900447:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d4312 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.900456:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d4312 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.900465:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d4312 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.900472:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d4312 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.900481:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789115619.900811:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789115619.900824:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bcd5f0d/0xa47abda6516d430b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.900846:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacca00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115619.900851:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcd5f0d/0xa47abda6516d430b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.900861:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcd5f0d/0xa47abda6516d430b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.900887:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bcd5f0d/0xa47abda6516d430b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.900897:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bcd5f0d/0xa47abda6516d430b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.900918:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115619.900921:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d4312 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.900926:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc800 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115619.900929:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d4312 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.900939:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d4312 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.900947:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d4312 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.900958:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbe78050/0xa47abda6516d4312 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.900968:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.900970:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.900971:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.901506:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.901514:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845c502d/0xa47abda6516d4319 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.901525:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.901528:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.901533:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845c502d/0xa47abda6516d4319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.901544:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000845c502d/0xa47abda6516d4319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.901563:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845c502d/0xa47abda6516d4319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.901570:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000845c502d/0xa47abda6516d4319 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.901587:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789115619.901636:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115619.901641:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000845c502d/0xa47abda6516d4319 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.901651:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacd000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115619.901654:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000845c502d/0xa47abda6516d4319 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.901662:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000845c502d/0xa47abda6516d4319 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.901672:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000845c502d/0xa47abda6516d4319 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.901679:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000845c502d/0xa47abda6516d4319 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.901693:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.901694:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.901696:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.902160:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.902166:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062cb3d91/0xa47abda6516d4320 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.902174:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.902178:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.902181:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062cb3d91/0xa47abda6516d4320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.902190:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062cb3d91/0xa47abda6516d4320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.902198:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062cb3d91/0xa47abda6516d4320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.902205:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062cb3d91/0xa47abda6516d4320 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.902270:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789115619.902686:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.902693:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6e08173/0xa47abda6516d4327 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.902701:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.902704:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.902708:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6e08173/0xa47abda6516d4327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.902717:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6e08173/0xa47abda6516d4327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.902724:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6e08173/0xa47abda6516d4327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.902730:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6e08173/0xa47abda6516d4327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.902963:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789115619.902973:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789115619.902981:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062cb3d91/0xa47abda6516d4320 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.902991:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacd400 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115619.902995:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062cb3d91/0xa47abda6516d4320 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.903006:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062cb3d91/0xa47abda6516d4320 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.903033:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062cb3d91/0xa47abda6516d4320 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.903041:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062cb3d91/0xa47abda6516d4320 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.903062:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115619.903065:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6e08173/0xa47abda6516d4327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.903072:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc400 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115619.903076:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6e08173/0xa47abda6516d4327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.903084:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6e08173/0xa47abda6516d4327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.903109:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6e08173/0xa47abda6516d4327 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.903117:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6e08173/0xa47abda6516d4327 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.903151:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.903154:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.903157:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115619.903286:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115619.903296:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d590aadf/0xa47abda6516d4304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.903304:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacdc00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115619.903307:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d590aadf/0xa47abda6516d4304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.903315:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d590aadf/0xa47abda6516d4304 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.903341:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d590aadf/0xa47abda6516d4304 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.903347:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d590aadf/0xa47abda6516d4304 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.903362:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115619.903364:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115619.903366:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115619.903371:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115619.903372:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.903958:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.903965:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0151a21/0xa47abda6516d432e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.903975:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.903984:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.903990:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0151a21/0xa47abda6516d432e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.904002:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0151a21/0xa47abda6516d432e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.904010:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0151a21/0xa47abda6516d432e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.904018:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0151a21/0xa47abda6516d432e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.904034:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789115619.904044:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789115619.904049:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0151a21/0xa47abda6516d432e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.904056:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedaccc00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:2.0:1789115619.904318:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0151a21/0xa47abda6516d432e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.904490:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0151a21/0xa47abda6516d432e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.904505:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0151a21/0xa47abda6516d432e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.904523:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0151a21/0xa47abda6516d432e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.904538:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115619.904540:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115619.904542:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.905683:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.905692:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044daffd8/0xa47abda6516d4335 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.905705:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.905709:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.905714:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044daffd8/0xa47abda6516d4335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.905725:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044daffd8/0xa47abda6516d4335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.905734:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044daffd8/0xa47abda6516d4335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.905741:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044daffd8/0xa47abda6516d4335 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.905766:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789115619.905920:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115619.905927:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044daffd8/0xa47abda6516d4335 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.905935:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115619.905939:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044daffd8/0xa47abda6516d4335 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.905954:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044daffd8/0xa47abda6516d4335 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.905970:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044daffd8/0xa47abda6516d4335 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.905977:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044daffd8/0xa47abda6516d4335 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.905993:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115619.905995:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115619.905996:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.906897:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.906911:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de643fd2/0xa47abda6516d433c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.906922:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.906926:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.906931:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de643fd2/0xa47abda6516d433c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.906942:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de643fd2/0xa47abda6516d433c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.906951:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de643fd2/0xa47abda6516d433c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.906958:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de643fd2/0xa47abda6516d433c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.906975:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789115619.906985:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789115619.906990:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de643fd2/0xa47abda6516d433c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.906997:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f400 already unused, calling callback (ffffffffc1728550) 00010000:00010000:2.0:1789115619.907001:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de643fd2/0xa47abda6516d433c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.907009:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de643fd2/0xa47abda6516d433c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.907029:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de643fd2/0xa47abda6516d433c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.907037:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de643fd2/0xa47abda6516d433c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.907051:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115619.907053:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115619.907055:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.908138:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.908148:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ef65b85/0xa47abda6516d4343 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.908159:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.908162:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.908167:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ef65b85/0xa47abda6516d4343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.908177:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ef65b85/0xa47abda6516d4343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.908185:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ef65b85/0xa47abda6516d4343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.908193:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ef65b85/0xa47abda6516d4343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.908223:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789115619.908280:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115619.908287:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ef65b85/0xa47abda6516d4343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.908295:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e200 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115619.908299:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ef65b85/0xa47abda6516d4343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.908307:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ef65b85/0xa47abda6516d4343 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.908321:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ef65b85/0xa47abda6516d4343 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.908328:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ef65b85/0xa47abda6516d4343 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.908355:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.908357:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.908358:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.908643:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.908649:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003961593c/0xa47abda6516d434a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.908657:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.908660:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.908664:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003961593c/0xa47abda6516d434a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.908673:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003961593c/0xa47abda6516d434a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.908681:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003961593c/0xa47abda6516d434a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.908689:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003961593c/0xa47abda6516d434a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.908708:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789115619.908791:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115619.908797:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003961593c/0xa47abda6516d434a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.908806:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28fc00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115619.908809:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003961593c/0xa47abda6516d434a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.908817:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003961593c/0xa47abda6516d434a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.908829:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003961593c/0xa47abda6516d434a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.908848:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003961593c/0xa47abda6516d434a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.908861:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115619.908863:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115619.908864:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.909346:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.909352:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000229a3598/0xa47abda6516d4351 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.909361:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.909370:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.909375:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000229a3598/0xa47abda6516d4351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.909688:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000229a3598/0xa47abda6516d4351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.909698:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000229a3598/0xa47abda6516d4351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.909705:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000229a3598/0xa47abda6516d4351 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.909727:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789115619.909739:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115619.909746:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000229a3598/0xa47abda6516d4351 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.909754:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e800 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115619.909758:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000229a3598/0xa47abda6516d4351 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.909766:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000229a3598/0xa47abda6516d4351 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.909778:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000229a3598/0xa47abda6516d4351 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.909785:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000229a3598/0xa47abda6516d4351 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.909806:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115619.909807:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115619.909809:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789115619.911263:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789115619.911738:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.911747:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d497763/0xa47abda6516d4358 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.911760:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.911764:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.911769:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d497763/0xa47abda6516d4358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.911781:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d497763/0xa47abda6516d4358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.911789:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d497763/0xa47abda6516d4358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.911804:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d497763/0xa47abda6516d4358 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.911855:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789115619.912282:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.912288:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c24b685/0xa47abda6516d435f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.912296:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.912299:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.912303:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c24b685/0xa47abda6516d435f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.912313:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c24b685/0xa47abda6516d435f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.912320:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c24b685/0xa47abda6516d435f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.912326:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c24b685/0xa47abda6516d435f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.912682:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789115619.912690:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d497763/0xa47abda6516d4358 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.912698:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28fa00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115619.912703:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d497763/0xa47abda6516d4358 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.912712:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d497763/0xa47abda6516d4358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.912729:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d497763/0xa47abda6516d4358 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.912736:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d497763/0xa47abda6516d4358 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.912755:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115619.912759:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c24b685/0xa47abda6516d435f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.912765:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ee00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115619.912775:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c24b685/0xa47abda6516d435f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.912784:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c24b685/0xa47abda6516d435f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.912794:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c24b685/0xa47abda6516d435f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.912802:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.912803:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.912805:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115619.912885:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789115619.912899:0:15540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c24b685/0xa47abda6516d435f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.912943:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.913353:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.913360:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082688b47/0xa47abda6516d4366 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.913369:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.913372:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.913377:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082688b47/0xa47abda6516d4366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.913508:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082688b47/0xa47abda6516d4366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.913517:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082688b47/0xa47abda6516d4366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.913525:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082688b47/0xa47abda6516d4366 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.913570:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789115619.913629:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115619.913635:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082688b47/0xa47abda6516d4366 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.913643:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e600 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115619.913647:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082688b47/0xa47abda6516d4366 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.913662:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082688b47/0xa47abda6516d4366 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.913678:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082688b47/0xa47abda6516d4366 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.913685:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082688b47/0xa47abda6516d4366 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.913699:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115619.913701:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115619.913703:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.913978:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.913984:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000921c5923/0xa47abda6516d436d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.913992:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.913995:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.914005:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000921c5923/0xa47abda6516d436d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.914014:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000921c5923/0xa47abda6516d436d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.914021:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000921c5923/0xa47abda6516d436d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.914027:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000921c5923/0xa47abda6516d436d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.914082:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789115619.914534:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.914541:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d17fd54/0xa47abda6516d4374 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.914549:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.914552:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.914556:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d17fd54/0xa47abda6516d4374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.914565:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d17fd54/0xa47abda6516d4374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.914573:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d17fd54/0xa47abda6516d4374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.914592:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d17fd54/0xa47abda6516d4374 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.914634:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789115619.914641:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000921c5923/0xa47abda6516d436d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.914649:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f800 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115619.914652:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000921c5923/0xa47abda6516d436d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.914661:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000921c5923/0xa47abda6516d436d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.914673:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000921c5923/0xa47abda6516d436d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.914681:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000921c5923/0xa47abda6516d436d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.914703:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115619.914706:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d17fd54/0xa47abda6516d4374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.914713:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f600 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115619.914716:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d17fd54/0xa47abda6516d4374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.914724:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d17fd54/0xa47abda6516d4374 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.914734:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d17fd54/0xa47abda6516d4374 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.914741:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.914743:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.914745:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115619.914813:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789115619.914818:0:15540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d17fd54/0xa47abda6516d4374 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789115619.915236:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.915242:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b51cfb31/0xa47abda6516d437b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.915251:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.915254:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.915259:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b51cfb31/0xa47abda6516d437b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.915268:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b51cfb31/0xa47abda6516d437b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.915275:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b51cfb31/0xa47abda6516d437b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.915282:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b51cfb31/0xa47abda6516d437b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.915324:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115619.915331:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b51cfb31/0xa47abda6516d437b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.915338:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f200 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115619.915342:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b51cfb31/0xa47abda6516d437b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.915349:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b51cfb31/0xa47abda6516d437b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.915360:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b51cfb31/0xa47abda6516d437b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.915368:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115619.915369:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115619.915371:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115619.915479:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789115619.915484:0:15540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b51cfb31/0xa47abda6516d437b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789115619.915872:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.915879:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030b560fe/0xa47abda6516d4382 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.915887:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.915891:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.915895:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030b560fe/0xa47abda6516d4382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.915905:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030b560fe/0xa47abda6516d4382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.915912:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030b560fe/0xa47abda6516d4382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.915916:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115619.915922:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030b560fe/0xa47abda6516d4382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.915977:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789115619.916376:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.916422:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d4389 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.916438:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.916441:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.916445:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d4389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.916453:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d4389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.916462:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d4389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.916469:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d4389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.916614:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789115619.916635:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789115619.916646:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030b560fe/0xa47abda6516d4382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.916654:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28fe00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115619.916658:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030b560fe/0xa47abda6516d4382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.916666:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030b560fe/0xa47abda6516d4382 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.916680:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030b560fe/0xa47abda6516d4382 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.916687:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030b560fe/0xa47abda6516d4382 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.916702:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115619.916706:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d4389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.916712:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e400 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115619.916715:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d4389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.916723:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d4389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.916744:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d4389 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.916752:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007113008/0xa47abda6516d4389 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.916765:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115619.916767:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115619.916769:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.916802:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.917020:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.917024:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d4390 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.917030:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.917032:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.917035:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d4390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.917041:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d4390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.917053:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d4390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.917058:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d4390 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.917079:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789115619.917677:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.917682:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ab3665/0xa47abda6516d4397 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.917689:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.917692:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.917695:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ab3665/0xa47abda6516d4397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.917700:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4ab3665/0xa47abda6516d4397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.917705:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ab3665/0xa47abda6516d4397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.917710:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ab3665/0xa47abda6516d4397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.917732:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789115619.917912:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789115619.917919:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d4390 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.917926:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115619.917929:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d4390 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.917947:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d4390 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.917959:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d4390 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.917966:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c354ba/0xa47abda6516d4390 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.917983:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115619.917986:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4ab3665/0xa47abda6516d4397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.917992:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ea00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115619.917995:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4ab3665/0xa47abda6516d4397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.918002:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4ab3665/0xa47abda6516d4397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.918012:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4ab3665/0xa47abda6516d4397 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.918019:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4ab3665/0xa47abda6516d4397 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.918042:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.918043:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.918045:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.918089:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.918094:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9c8537c/0xa47abda6516d439e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.918102:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.918105:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.918109:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9c8537c/0xa47abda6516d439e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.918117:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9c8537c/0xa47abda6516d439e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.918125:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9c8537c/0xa47abda6516d439e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.918133:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9c8537c/0xa47abda6516d439e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.918187:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789115619.918613:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115619.918613:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789115619.918619:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd7c6652/0xa47abda6516d43a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.918620:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9c8537c/0xa47abda6516d439e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.918628:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1789115619.918629:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521400 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115619.918632:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9c8537c/0xa47abda6516d439e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.918636:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.918641:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd7c6652/0xa47abda6516d43a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.918641:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9c8537c/0xa47abda6516d439e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.918650:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd7c6652/0xa47abda6516d43a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.918653:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9c8537c/0xa47abda6516d439e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.918658:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd7c6652/0xa47abda6516d43a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.918662:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9c8537c/0xa47abda6516d439e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.918666:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd7c6652/0xa47abda6516d43a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.918685:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789115619.918697:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115619.918701:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd7c6652/0xa47abda6516d43a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.918708:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1520600 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115619.918711:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd7c6652/0xa47abda6516d43a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.918718:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd7c6652/0xa47abda6516d43a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.918729:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd7c6652/0xa47abda6516d43a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.918736:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd7c6652/0xa47abda6516d43a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115619.918747:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115619.918749:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115619.918750:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.919070:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.919076:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ac5c25/0xa47abda6516d43ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.919084:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.919087:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.919091:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042ac5c25/0xa47abda6516d43ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.919100:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042ac5c25/0xa47abda6516d43ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.919108:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ac5c25/0xa47abda6516d43ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.919122:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042ac5c25/0xa47abda6516d43ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.919143:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789115619.919483:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115619.919492:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042ac5c25/0xa47abda6516d43ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.919510:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521600 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115619.919514:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ac5c25/0xa47abda6516d43ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.919523:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ac5c25/0xa47abda6516d43ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.919538:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042ac5c25/0xa47abda6516d43ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.919546:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042ac5c25/0xa47abda6516d43ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.919564:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115619.919566:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115619.919569:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.919584:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.919591:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000200f36f0/0xa47abda6516d43b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.919600:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.919603:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.919607:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000200f36f0/0xa47abda6516d43b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.919617:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000200f36f0/0xa47abda6516d43b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.919617:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115619.919625:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000200f36f0/0xa47abda6516d43b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.919632:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000200f36f0/0xa47abda6516d43b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.919708:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789115619.919900:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115619.919905:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000200f36f0/0xa47abda6516d43b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.919912:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521e00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115619.919915:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000200f36f0/0xa47abda6516d43b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.919922:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000200f36f0/0xa47abda6516d43b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.919938:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000200f36f0/0xa47abda6516d43b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.919944:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000200f36f0/0xa47abda6516d43b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115619.919958:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115619.919960:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115619.919961:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789115619.920274:0:15540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789115619.920280:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ea9421/0xa47abda6516d43ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.920293:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1789115619.920296:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115619.920301:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ea9421/0xa47abda6516d43ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.920310:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067ea9421/0xa47abda6516d43ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.920317:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ea9421/0xa47abda6516d43ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.920323:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067ea9421/0xa47abda6516d43ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115619.920343:0:15540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789115619.920542:0:15540:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1789115619.920635:0:15540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc098f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14877:x1876023308291840:12345-0@lo:5:osp-pre-0-0.0 Request processed in 41718us (41849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115619.920645:0:15540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789115619.920727:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115619.920735:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067ea9421/0xa47abda6516d43ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.920742:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1520000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115619.920745:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ea9421/0xa47abda6516d43ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.920752:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ea9421/0xa47abda6516d43ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.920764:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067ea9421/0xa47abda6516d43ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.920770:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067ea9421/0xa47abda6516d43ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115619.920787:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.920789:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115619.920791:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115619.920960:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115619.920993:0:14877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc0983c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14877:1876023308291840:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789115619.921009:0:14877:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1789115619.921051:0:14877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc0983c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14877:1876023308291968:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789115619.921236:0:14877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115619.921270:0:14877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee411240 going to sleep for 11 seconds 00000100:00100000:0.0:1789115619.921699:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308291968 00000100:00100000:0.0:1789115619.921706:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308291968 00000100:00100000:0.0:1789115619.921752:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789115619.921761:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc099a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14877:x1876023308291968:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789115619.921801:0:15543:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1789115619.928761:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc099a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14877:x1876023308291968:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6994us (7517us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789115619.928777:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789115619.928927:0:14877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc0983c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14877:1876023308291968:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789115619.928942:0:14877:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1789115620.843897:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789115621.420371:0:16260:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789115621.420376:0:16260:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789115621.421926:0:16260:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dfcc2c0f000 00000020:01000004:3.0:1789115621.421960:0:16260:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789115621.422031:0:16260:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789115621.422050:0:16260:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8dfcfbb00000) 00000020:00000080:3.0:1789115621.422073:0:16260:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789115621.445645:0:16260:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789115621.445917:0:16260:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789115621.446671:0:16260:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789115621.446924:0:16260:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789115621.447139:0:16260:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789115621.448234:0:16260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 609: rc = 0 00100000:10000000:3.0:1789115621.448334:0:16260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 609: rc = 0 00100000:10000000:3.0:1789115621.448632:0:16260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 609: rc = 0 00100000:10000000:3.0:1789115621.449179:0:16260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 53: rc = 0 00100000:10000000:3.0:1789115621.449602:0:16260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 53: rc = 0 00100000:10000000:3.0:1789115621.449878:0:16260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 53: rc = 0 00100000:10000000:3.0:1789115621.450148:0:16260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 53: rc = 0 00100000:10000000:3.0:1789115621.450565:0:16260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 53: rc = 0 00100000:10000000:3.0:1789115621.454048:0:16260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 53: rc = 0 00000020:00000080:3.0:1789115621.455897:0:16260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789115621.455914:0:16260:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789115621.455929:0:16260:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa47abda6516d43c8 00000020:01000004:3.0:1789115621.455939:0:16260:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789115621.455966:0:16260:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789115621.455970:0:16260:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789115621.455978:0:16260:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789115621.456005:0:16260:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789115621.456010:0:16260:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789115621.473035:0:16260:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789115621.473088:0:16260:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789115621.473093:0:16260:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789115621.473095:0:16260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789115621.473097:0:16260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789115621.473098:0:16260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789115621.473099:0:16260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789115621.473101:0:16260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789115621.473102:0:16260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789115621.473105:0:16260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789115621.473106:0:16260:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789115621.473112:0:16260:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789115621.473114:0:16260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789115621.473116:0:16260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789115621.473117:0:16260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789115621.473118:0:16260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789115621.473120:0:16260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789115621.473121:0:16260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789115621.473122:0:16260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789115621.473123:0:16260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789115621.473124:0:16260:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789115621.473161:0:16260:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789115621.473190:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3303c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292096:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789115621.473286:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115621.473465:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc816b180 going to sleep for 11 seconds 00000100:00100000:3.0:1789115621.473720:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308292096 00000100:00100000:3.0:1789115621.473730:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308292096 00000100:00100000:3.0:1789115621.473843:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789115621.473854:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+16:16260:x1876023308292096:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789115621.473906:0:14848:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789115621.473915:0:14848:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789115621.473919:0:14848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789115621.483928:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+16:16260:x1876023308292096:12345-0@lo:253:mount.lustre.0 Request processed in 10063us (10629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115621.483947:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789115621.484124:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3303c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292096:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789115621.484142:0:16260:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789115621.484146:0:16260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789115621.484148:0:16260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789115621.484150:0:16260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789115621.484151:0:16260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789115621.484152:0:16260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789115621.484154:0:16260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789115621.484156:0:16260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789115621.484159:0:16260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789115621.484161:0:16260:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789115621.484201:0:16260:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dfcc2c0f000 from lustre-OST0001 10000000:01000000:1.0:1789115621.484238:0:16260:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789115621.484241:0:16260:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789115621.484251:0:16260:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dfcf5323490 local copy 00010000:00010000:1.0:1789115621.484266:0:16260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6a00/0xa47abda6516d416e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4175 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115621.484666:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3303c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789115621.484715:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115621.484747:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc62d4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789115621.484834:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308292224 00000100:00100000:0.0:1789115621.484841:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308292224 00000100:00100000:0.0:1789115621.484906:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789115621.484917:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+16:16260:x1876023308292224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789115621.485205:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+16:16260:x1876023308292224:12345-0@lo:501:mount.lustre.0 Request processed in 290us (489us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789115621.485214:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789115621.485633:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3303c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292224:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789115621.485650:0:16260:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789115621.485839:0:16260:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789115621.485857:0:16260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6a00/0xa47abda6516d416e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4175 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.485869:0:16260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6a00/0xa47abda6516d416e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4175 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115621.485964:0:16260:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dfcc2c0f000 10000000:01000000:2.0:1789115621.485971:0:16260:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789115621.485978:0:16260:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789115621.485980:0:16260:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789115621.485985:0:16260:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789115621.485989:0:16260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789115621.486025:0:16260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520e00/0xa47abda6516d43cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.486034:0:16260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520e00/0xa47abda6516d43cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.486045:0:16260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520e00/0xa47abda6516d43cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115621.486065:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789115621.486112:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115621.486155:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308292352 00000100:00100000:2.0:1789115621.486161:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308292352 00000100:00100000:2.0:1789115621.486197:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789115621.486205:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+16:16260:x1876023308292352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789115621.486219:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115621.486235:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc1521000/0xa47abda6516d43d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d43cf expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.486270:0:14848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1521000/0xa47abda6516d43d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d43cf expref: 17 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.486282:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc1521000/0xa47abda6516d43d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d43cf expref: 17 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.486293:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1521000, rc 0) 00000100:00100000:2.0:1789115621.486325:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+17:16260:x1876023308292352:12345-0@lo:101:mount.lustre.0 Request processed in 121us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115621.486332:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789115621.486833:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88eef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789115621.486859:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789115621.486877:0:16260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520e00/0xa47abda6516d43cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d43d6 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.487009:0:16260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520e00/0xa47abda6516d43cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d43d6 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789115621.488129:0:16260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789115621.490034:0:16260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789115621.490554:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789115621.490608:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789115621.490645:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789115621.490690:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789115621.490724:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789115621.490757:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789115621.490826:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789115621.490834:0:16260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789115621.490971:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2572940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789115621.491063:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115621.491198:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd0de4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789115621.491515:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308292480 00000100:00100000:2.0:1789115621.491526:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308292480 00000100:00100000:2.0:1789115621.491592:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789115621.491604:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+17:16260:x1876023308292480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789115621.492656:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+17:16260:x1876023308292480:12345-0@lo:501:mount.lustre.0 Request processed in 1050us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115621.492669:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789115621.492771:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2572940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789115621.492831:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2572940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789115621.492951:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115621.493029:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd0de4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789115621.493066:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308292608 00000100:00100000:2.0:1789115621.493073:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308292608 00000100:00100000:2.0:1789115621.493152:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789115621.493161:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+17:16260:x1876023308292608:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789115621.493562:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+17:16260:x1876023308292608:12345-0@lo:503:mount.lustre.0 Request processed in 400us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115621.493570:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789115621.493673:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2572940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292608:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789115621.494524:0:16260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789115621.494628:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2572940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789115621.494692:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115621.495130:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd0de4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789115621.495222:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308292736 00000100:00100000:3.0:1789115621.495230:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308292736 00000100:00100000:1.0:1789115621.495600:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789115621.495612:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+17:16260:x1876023308292736:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789115621.496157:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+17:16260:x1876023308292736:12345-0@lo:502:mount.lustre.0 Request processed in 544us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115621.496165:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789115621.496286:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2572940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292736:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789115621.496801:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789115621.496867:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789115621.497120:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789115621.497180:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789115621.497222:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789115621.497260:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789115621.497311:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789115621.497348:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789115621.497631:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789115621.497687:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2572940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789115621.497776:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115621.497875:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd0de4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789115621.497991:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308292864 00000100:00100000:1.0:1789115621.497999:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308292864 00000100:00100000:1.0:1789115621.498101:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789115621.498112:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+17:16260:x1876023308292864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789115621.498348:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+17:16260:x1876023308292864:12345-0@lo:502:mount.lustre.0 Request processed in 237us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115621.498356:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789115621.498605:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2572940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789115621.498700:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1789115621.498715:0:16260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1789115621.500266:0:16262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789115621.500281:0:16262:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789115621.500290:0:16262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789115621.500292:0:16262:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789115621.500302:0:16262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789115621.500322:0:16262:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8dfcfbb04ed8) 00000020:00000080:3.0:1789115621.500352:0:16262:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789115621.500360:0:16262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789115621.500602:0:16262:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dfcc2c0f000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789115621.500612:0:16262:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789115621.500620:0:16262:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa47abda6516d43e4 00010000:00010000:0.0:1789115621.506064:0:16262:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1789115621.507361:0:16262:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1789115621.510274:0:16262:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1789115621.513213:0:16262:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789115621.513231:0:16262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115621.513238:0:16262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115621.513240:0:16262:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789115621.513245:0:16262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115621.513250:0:16262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115621.513260:0:16262:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789115621.513264:0:16262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789115621.513267:0:16262:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789115621.513269:0:16262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115621.513271:0:16262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115621.513272:0:16262:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789115621.513274:0:16262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115621.513277:0:16262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115621.513278:0:16262:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789115621.513282:0:16262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789115621.513324:0:16262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115621.513328:0:16262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115621.513329:0:16262:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789115621.513332:0:16262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789115621.513637:0:16260:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789115621.513676:0:16260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789115621.513705:0:16260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520e00/0xa47abda6516d43cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d43d6 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.513721:0:16260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520e00/0xa47abda6516d43cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d43d6 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115621.513731:0:16260:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcc2c0f000 from 1 10000000:01000000:2.0:1789115621.513735:0:16260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789115621.513782:0:16260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.513791:0:16260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.513804:0:16260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115621.513835:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789115621.513937:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115621.513990:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88ee900 going to sleep for 11 seconds 00000100:00100000:1.0:1789115621.514127:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308292992 00000100:00100000:1.0:1789115621.514137:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308292992 00000100:00100000:1.0:1789115621.514199:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789115621.514211:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+17:16260:x1876023308292992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789115621.514228:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115621.514244:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d43f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d43eb expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115621.514273:0:14848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d43f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d43eb expref: 18 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115621.514286:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d43f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d43eb expref: 18 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115621.514296:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7400, rc 0) 00000100:00100000:1.0:1789115621.514342:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+18:16260:x1876023308292992:12345-0@lo:101:mount.lustre.0 Request processed in 134us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115621.514350:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789115621.515052:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308292992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789115621.515075:0:16260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d43f2 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.515087:0:16260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d43f2 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789115621.516662:0:16260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789115621.517952:0:16260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789115621.518258:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789115621.518307:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789115621.518372:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789115621.518670:0:16260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789115621.518786:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308293120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789115621.518881:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115621.518953:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88ee900 going to sleep for 11 seconds 00000100:00100000:3.0:1789115621.521588:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308293120 00000100:00100000:3.0:1789115621.521608:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308293120 00000100:00100000:3.0:1789115621.521690:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789115621.521702:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+18:16260:x1876023308293120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789115621.522105:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+18:16260:x1876023308293120:12345-0@lo:501:mount.lustre.0 Request processed in 403us (3221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115621.522114:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789115621.523637:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308293120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789115621.523717:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308293248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789115621.523801:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115621.523848:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88ee900 going to sleep for 11 seconds 00000100:00100000:3.0:1789115621.523989:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308293248 00000100:00100000:3.0:1789115621.523997:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308293248 00000100:00100000:3.0:1789115621.524057:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789115621.524068:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+18:16260:x1876023308293248:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789115621.525154:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+18:16260:x1876023308293248:12345-0@lo:503:mount.lustre.0 Request processed in 1080us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115621.525166:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789115621.525574:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308293248:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789115621.530872:0:16260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789115621.531053:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308293376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789115621.531164:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115621.531270:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88ee900 going to sleep for 11 seconds 00000100:00100000:1.0:1789115621.533683:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308293376 00000100:00100000:1.0:1789115621.533702:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308293376 00000100:00100000:1.0:1789115621.534816:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789115621.534839:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc66eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+18:16260:x1876023308293376:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789115621.535264:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc66eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+18:16260:x1876023308293376:12345-0@lo:502:mount.lustre.0 Request processed in 432us (4097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115621.535275:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789115621.535593:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308293376:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789115621.536639:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789115621.536720:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789115621.536771:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789115621.536822:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789115621.536854:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789115621.536913:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789115621.536950:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789115621.536984:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:3.0:1789115621.537029:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:3.0:1789115621.537065:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:3.0:1789115621.537140:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:3.0:1789115621.537197:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308293504:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789115621.537283:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115621.538018:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcee4119c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115621.538103:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308293504 00000100:00100000:2.0:1789115621.538113:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308293504 00000100:00100000:2.0:1789115621.538178:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789115621.538188:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+18:16260:x1876023308293504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789115621.538684:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+18:16260:x1876023308293504:12345-0@lo:502:mount.lustre.0 Request processed in 495us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115621.538695:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789115621.538825:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308293504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789115621.539009:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:3.0:1789115621.539026:0:16260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789115621.540581:0:16266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115621.540595:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115621.540599:0:16266:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789115621.540608:0:16266:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dfcc2c0f000 00000020:00000080:1.0:1789115621.540611:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789115621.540621:0:16266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115621.540623:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115621.540625:0:16266:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789115621.540627:0:16266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115621.540630:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115621.540631:0:16266:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789115621.540634:0:16266:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dfcc2c0f000 00000020:00000080:1.0:1789115621.540636:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789115621.540708:0:16266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115621.540712:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115621.540713:0:16266:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789115621.540716:0:16266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115621.540718:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115621.540719:0:16266:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789115621.540723:0:16266:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dfcc2c0f000 00000020:00000080:1.0:1789115621.540725:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789115621.540746:0:16266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115621.540749:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115621.540751:0:16266:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789115621.540753:0:16266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789115621.540765:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115621.540766:0:16266:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789115621.540771:0:16266:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dfcc2c0f000 00000020:00000080:1.0:1789115621.540773:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789115621.540813:0:16266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789115621.540817:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789115621.540818:0:16266:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789115621.540822:0:16266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789115621.541719:0:16260:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789115621.541755:0:16260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789115621.541782:0:16260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d43f2 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.541798:0:16260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d43f2 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115621.541858:0:16260:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789115621.541862:0:16260:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dfcc2c0f000 10000000:01000000:2.0:1789115621.541866:0:16260:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dfcc2c0f000 10000000:01000000:2.0:1789115621.541871:0:16260:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789115621.542528:0:16260:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dfcc2c0f000 from 1 10000000:01000000:2.0:1789115621.542534:0:16260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789115621.542584:0:16260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d43f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.542595:0:16260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d43f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.542607:0:16260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d43f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115621.542639:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308293632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789115621.542737:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115621.542777:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88ee600 going to sleep for 11 seconds 00000100:00100000:1.0:1789115621.542981:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308293632 00000100:00100000:1.0:1789115621.542992:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308293632 00000100:00100000:1.0:1789115621.543057:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789115621.543068:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+18:16260:x1876023308293632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789115621.543085:0:14849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115621.543101:0:14849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedac7c00/0xa47abda6516d4400 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d43f9 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115621.543131:0:14849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedac7c00/0xa47abda6516d4400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d43f9 expref: 19 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115621.543143:0:14849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedac7c00/0xa47abda6516d4400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d43f9 expref: 19 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115621.543152:0:14849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac7c00, rc 0) 00000100:00100000:1.0:1789115621.543198:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+19:16260:x1876023308293632:12345-0@lo:101:mount.lustre.0 Request processed in 132us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115621.543205:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789115621.543594:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308293632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789115621.543612:0:16260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d43f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4400 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.543624:0:16260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d43f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d4400 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789115621.545815:0:16260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789115621.548052:0:16260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789115621.548523:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789115621.548573:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789115621.548607:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789115621.548650:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789115621.548686:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789115621.548734:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789115621.548770:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789115621.548804:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789115621.548854:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789115621.549040:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789115621.549080:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789115621.549132:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789115621.549168:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789115621.549202:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789115621.549271:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789115621.549320:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789115621.549354:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789115621.549616:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789115621.549653:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789115621.549682:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789115621.549739:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789115621.549772:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789115621.549797:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789115621.549837:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789115621.549864:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789115621.551670:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789115621.551808:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789115621.551842:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789115621.551874:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789115621.552836:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1789115621.552891:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1789115621.552947:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1789115621.552977:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1789115621.553024:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1789115621.553061:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1789115621.553106:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1789115621.553135:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1789115621.553237:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1789115621.553245:0:16260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789115621.553789:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308293760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789115621.554675:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115621.554765:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88ee600 going to sleep for 11 seconds 00000100:00100000:3.0:1789115621.554976:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308293760 00000100:00100000:3.0:1789115621.554987:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308293760 00000100:00100000:3.0:1789115621.555056:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789115621.555068:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+19:16260:x1876023308293760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789115621.559505:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+19:16260:x1876023308293760:12345-0@lo:501:mount.lustre.0 Request processed in 4425us (4820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115621.559526:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789115621.563297:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308293760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789115621.563537:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2572940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308293888:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789115621.563638:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115621.563694:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc5df3540 going to sleep for 11 seconds 00000100:00100000:3.0:1789115621.565213:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308293888 00000100:00100000:3.0:1789115621.565230:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308293888 00000100:00100000:3.0:1789115621.565318:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789115621.565330:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+19:16260:x1876023308293888:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789115621.567565:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+19:16260:x1876023308293888:12345-0@lo:503:mount.lustre.0 Request processed in 2218us (3908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115621.567585:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789115621.573066:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2572940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308293888:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789115621.575349:0:16260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789115621.575514:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308294016:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789115621.575629:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115621.575693:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308294016 00000100:00100000:3.0:1789115621.575696:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc8980300 going to sleep for 11 seconds 00000100:00100000:2.0:1789115621.575703:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308294016 00000100:00100000:2.0:1789115621.575770:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789115621.575784:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+19:16260:x1876023308294016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789115621.577346:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+19:16260:x1876023308294016:12345-0@lo:502:mount.lustre.0 Request processed in 1554us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115621.577361:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789115621.577500:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308294016:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789115621.578787:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789115621.578873:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789115621.578902:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789115621.578950:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789115621.578988:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789115621.579930:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789115621.580601:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789115621.580782:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789115621.580883:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789115621.580932:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789115621.580976:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789115621.581065:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789115621.581258:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789115621.581305:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789115621.581425:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789115621.581466:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789115621.581501:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789115621.581969:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789115621.582023:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789115621.582072:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789115621.582439:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789115621.582486:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789115621.582524:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789115621.582579:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789115621.582626:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789115621.582779:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789115621.582839:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789115621.582899:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789115621.582936:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789115621.583009:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789115621.583052:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789115621.583095:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789115621.583379:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789115621.583482:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789115621.583520:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789115621.583591:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789115621.583631:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789115621.583794:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789115621.583856:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789115621.583905:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789115621.583982:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308294144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789115621.584091:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115621.584305:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88ee600 going to sleep for 11 seconds 00000100:00100000:3.0:1789115621.584614:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308294144 00000100:00100000:3.0:1789115621.584624:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308294144 00000100:00100000:3.0:1789115621.584759:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789115621.584775:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+19:16260:x1876023308294144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789115621.585068:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+19:16260:x1876023308294144:12345-0@lo:502:mount.lustre.0 Request processed in 299us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115621.585078:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789115621.585103:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308294144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789115621.585340:0:16260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789115621.585354:0:16260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789115621.590038:0:16271:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789115621.590068:0:16271:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8dfcfcfcced8) 00000020:00000080:2.0:1789115621.590100:0:16271:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1789115621.590936:0:16271:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dfcc2c0f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789115621.590945:0:16271:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dfcc2c0f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789115621.590948:0:16271:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dfcc2c0f000 3 00010000:00080000:2.0:1789115621.590991:0:16271:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dfcf46bb000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1789115621.601009:0:16271:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789115621.601292:0:16271:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789115621.601353:0:16271:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789115621.601405:0:16271:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa47abda6516d440e 00000100:00080000:3.0:1789115621.601419:0:16271:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789115621.601426:0:16271:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dfcf46bb000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1789115621.601542:0:16271:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfcfc099680 x1876023308294272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789115621.601575:0:16271:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789115621.601697:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876023308294272:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789115621.601961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789115621.602623:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789115621.602630:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789115621.602634:0:37:0:(import.c:65:import_set_state_nolock()) ffff8dfcc4f4f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789115621.602639:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:2.0:1789115621.602645:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789115621.602651:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dfcc4f4f000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1789115621.602680:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfcc5738780 x1876023308294528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789115621.602894:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308294400:0@lo:400:kworker.0 00000100:00100000:2.0:1789115621.602957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115621.603001:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789115621.603007:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308294656:0@lo:400:kworker.0 00000100:00100000:2.0:1789115621.603040:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308294784:0@lo:400:kworker.0 00000100:00100000:2.0:1789115621.603078:0:15540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308294400 00000100:00100000:2.0:1789115621.603086:0:15540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308294400 00000100:00100000:2.0:1789115621.603149:0:15540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789115621.603159:0:15540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1876023308294400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115621.603215:0:15540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1876023308294400:12345-0@lo:400:kworker.0 Request processed in 57us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115621.603223:0:15540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789115621.603245:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789115621.604056:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308294272 00000100:00100000:2.0:1789115621.604065:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308294272 00000100:00100000:2.0:1789115621.604103:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789115621.604110:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876023308294272:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789115621.604139:0:14854:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000100:00100000:3.0:1789115621.604171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1789115621.604183:0:14854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa47abda6516d4415 00000004:00100000:2.0:1789115621.604203:0:14854:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789115621.604245:0:14854:0:(import.c:65:import_set_state_nolock()) ffff8dfcf46b9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789115621.604260:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308294400:0@lo:400:kworker.0 00000100:00100000:0.0:1789115621.604321:0:14856:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789115621.604331:0:14856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789115621.604434:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876023308294272:12345-0@lo:38:llog_process_th.0 Request processed in 322us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115621.604442:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789115621.604457:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308294656 00000100:00100000:2.0:1789115621.604466:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308294656 00000100:00100000:2.0:1789115621.604497:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789115621.604504:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308294656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115621.604530:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115621.604539:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308294656:12345-0@lo:400:kworker.0 Request processed in 36us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115621.604545:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789115621.604554:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308294784 00000100:00100000:2.0:1789115621.604557:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308294784 00000100:00100000:2.0:1789115621.604583:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789115621.604588:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2572940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308294784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115621.604621:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2572940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308294784:12345-0@lo:400:kworker.0 Request processed in 32us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115621.604626:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789115621.604653:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcc5738f00 x1876023308294656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115621.604666:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308294656:0@lo:400:kworker.0 00000100:00080000:2.0:1789115621.604684:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789115621.604700:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcc573b0c0 x1876023308294784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789115621.604709:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308294784:0@lo:400:kworker.0 00010000:00080000:1.0:1789115621.604826:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dfcfc099680 x1876023308294272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789115631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115621.604848:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789115621.604857:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789115621.604866:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789115621.604871:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789115621.604875:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcf46bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789115621.604882:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876023308294272:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789115621.604904:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308294528:0@lo:8:kworker.0 00000100:00100000:1.0:1789115621.604940:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789115621.605186:0:16271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:2.0:1789115621.605424:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308294528 00000100:00100000:2.0:1789115621.605429:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308294528 00000100:00100000:2.0:1789115621.605454:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789115621.605460:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc333c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1876023308294528:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789115621.605513:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc333c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1876023308294528:12345-0@lo:8:kworker.0 Request processed in 53us (572us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789115621.605528:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789115621.605559:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789115621.605564:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcc4f4f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789115621.605568:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789115621.605571:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308294528:0@lo:8:kworker.0 00000020:01000000:2.0:1789115621.606504:0:16260:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789115621.606543:0:16260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789115621.606564:0:16260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d43f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4400 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115621.606577:0:16260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcc1520400/0xa47abda6516d43f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4400 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789115621.606630:0:16260:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789115621.606633:0:16260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789115621.606634:0:16260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115621.606635:0:16260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789115621.606636:0:16260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115621.606638:0:16260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115621.606640:0:16260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789115621.606642:0:16260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115621.606643:0:16260:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789115621.606648:0:16260:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789115621.606651:0:16260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789115621.606652:0:16260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789115621.606653:0:16260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115621.606655:0:16260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789115621.606656:0:16260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115621.606657:0:16260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115621.606658:0:16260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789115621.606659:0:16260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115621.606661:0:16260:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789115621.606686:0:16260:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789115621.606709:0:16260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308294912:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789115621.606769:0:16260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115621.606808:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308294912 00000100:00100000:2.0:1789115621.606814:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308294912 00000100:00100000:2.0:1789115621.606853:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789115621.606860:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+19:16260:x1876023308294912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789115621.606900:0:14848:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789115621.606916:0:14848:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789115621.607532:0:16260:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc88ee240 going to sleep for 11 seconds 20000000:01000000:0.0:1789115621.653758:0:14848:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789115621.653781:0:14848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789115621.653871:0:14870:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789115621.653899:0:14870:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789115621.653925:0:14870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.653947:0:14870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d42ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d42e8 expref: 19 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.653957:0:14870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654005:0:14870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d42ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d42e8 expref: 19 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654021:0:14870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d42ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d42e8 expref: 19 pid: 14846 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115621.654038:0:14870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14870:1876023308295040:0@lo:104: 00000100:00100000:3.0:1789115621.654118:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115621.654164:0:14870:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd8a8e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789115621.654197:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308295040 00000100:00100000:3.0:1789115621.654205:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308295040 00000100:00100000:3.0:1789115621.654253:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789115621.654261:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc099680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91237388-4e21-4f8d-88fa-5d733c21b708+3:14870:x1876023308295040:12345-0@lo:104: 00010000:00010000:3.0:1789115621.654277:0:14838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d42ef expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654328:0:14838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789115621.654334:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc099680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91237388-4e21-4f8d-88fa-5d733c21b708+3:14870:x1876023308295040:12345-0@lo:104: Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115621.654342:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789115621.654411:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115621.654419:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d42ef expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654427:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3e00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:3.0:1789115621.654431:0:14843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d42ef expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654441:0:14843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d42ef expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789115621.654449:0:14843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d42ef expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115621.654455:0:14843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789115621.654581:0:14843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d42ef expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654588:0:14843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789115621.654609:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d42ef expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654616:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3e00/0xa47abda6516d42e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d42ef expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654633:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115621.654635:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115621.654636:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115621.654654:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91237388-4e21-4f8d-88fa-5d733c21b708:3308:1876023308295168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789115621.654682:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115621.654722:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308295168 00000100:00100000:3.0:1789115621.654725:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308295168 00010000:00010000:3.0:1789115621.654743:0:14841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d42ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d42e8 expref: 20 pid: 14846 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115621.654764:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789115621.654770:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc098b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91237388-4e21-4f8d-88fa-5d733c21b708+20:3308:x1876023308295168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789115621.654780:0:14841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115621.654785:0:14841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d42ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d42e8 expref: 20 pid: 14846 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654796:0:14841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d42ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d42e8 expref: 20 pid: 14846 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654874:0:14841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654926:0:14841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789115621.654942:0:14841:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002412921s 00010000:00010000:3.0:1789115621.654947:0:14841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654955:0:14841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654962:0:14841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654968:0:14841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654983:0:14841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115621.654988:0:14841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.654996:0:14841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.655004:0:14841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.655014:0:14841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115621.655039:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc098b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91237388-4e21-4f8d-88fa-5d733c21b708+20:3308:x1876023308295168:12345-0@lo:103:ldlm_bl.0 Request processed in 270us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115621.655046:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789115621.655084:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91237388-4e21-4f8d-88fa-5d733c21b708:3308:1876023308295168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789115621.655107:0:14870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d42ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d42e8 expref: 19 pid: 14846 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115621.655117:0:14870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14870:1876023308295040:0@lo:104: 00010000:00010000:3.0:1789115621.655126:0:14870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.655136:0:14870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.655142:0:14870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115621.655158:0:14870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcff9eb000/0xa47abda6516d441c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115621.666906:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+18:16260:x1876023308294912:12345-0@lo:253:mount.lustre.0 Request processed in 60030us (60121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115621.666927:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789115621.667076:0:16260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91237388-4e21-4f8d-88fa-5d733c21b708:16260:1876023308294912:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789115621.667096:0:16260:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789115621.667099:0:16260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789115621.667101:0:16260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789115621.667102:0:16260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789115621.667103:0:16260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789115621.667104:0:16260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789115621.667106:0:16260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789115621.667108:0:16260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789115621.667110:0:16260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789115621.667112:0:16260:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789115621.667131:0:16260:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789115621.672249:0:16260:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789115621.672623:0:16260:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789115621.672994:0:16260:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789115621.673156:0:16260:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789115621.673347:0:16260:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789115621.673837:0:16260:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789115621.674942:0:16260:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789115621.733907:0:16260:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789115621.733918:0:16260:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789115621.733966:0:16260:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789115621.734043:0:16260:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789115621.734064:0:16260:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789115621.734100:0:16260:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789115621.863761:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789115622.885237:0:14851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789115622.885246:0:14851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dfcc5730000 from 8 10000000:01000000:1.0:1789115622.885251:0:14851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789115622.885301:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6200/0xa47abda6516d4423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115622.885313:0:14851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6200/0xa47abda6516d4423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115622.885337:0:14851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6200/0xa47abda6516d4423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115622.885364:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc333480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308295296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789115622.885462:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115622.885507:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd86fe780 going to sleep for 11 seconds 00000100:00100000:1.0:1789115622.885562:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308295296 00000100:00100000:1.0:1789115622.885569:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308295296 00000100:00100000:1.0:1789115622.885618:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789115622.885627:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+18:14851:x1876023308295296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115622.885640:0:14846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115622.885654:0:14846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcedac6800/0xa47abda6516d442a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d4423 expref: -99 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115622.885676:0:14846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcedac6800/0xa47abda6516d442a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d4423 expref: 19 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115622.885686:0:14846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcedac6800/0xa47abda6516d442a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d4423 expref: 19 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115622.885694:0:14846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcedac6800, rc 0) 00000100:00100000:1.0:1789115622.885732:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+19:14851:x1876023308295296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115622.885740:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:1.0:1789115622.885773:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115622.885810:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc333480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308295296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115622.885823:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6200/0xa47abda6516d4423 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d442a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115622.885840:0:14851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6200/0xa47abda6516d4423 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d442a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115622.885883:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc333480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308295424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789115622.885914:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115622.885928:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd86fe780 going to sleep for 11 seconds 00000100:00100000:1.0:1789115622.885941:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308295424 00000100:00100000:1.0:1789115622.885945:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308295424 00000100:00100000:1.0:1789115622.885967:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789115622.885972:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+19:14851:x1876023308295424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789115622.885984:0:14848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789115622.886000:0:14848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789115622.886003:0:14848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789115622.886145:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+19:14851:x1876023308295424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115622.886154:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789115622.886185:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc333480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308295424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789115622.886233:0:14851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789115622.886239:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6200/0xa47abda6516d4423 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d442a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115622.886248:0:14851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6200/0xa47abda6516d4423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d442a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789115623.161227:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789115623.161286:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789115623.909657:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115624.932397:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789115625.123909:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789115625.123930:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308295552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789115625.123997:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115625.124063:0:15545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308295552 00000100:00100000:3.0:1789115625.124070:0:15545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308295552 00000100:00100000:3.0:1789115625.124126:0:15545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789115625.124136:0:15545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308295552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789115625.124172:0:15545:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115625.124217:0:15545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308295552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115625.124223:0:15545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789115625.124245:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789115625.124270:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789115625.124304:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308295552:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789115625.966452:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789115626.406660:0:14889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1789115626.660707:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789115626.660719:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789115626.660724:0:37:0:(import.c:65:import_set_state_nolock()) ffff8dfcc4f4f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789115626.660734:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dfcc4f4f000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1789115626.660769:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dfcfc330000 x1876023308295936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789115626.660830:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308295808:0@lo:400:kworker.0 00000100:00100000:1.0:1789115626.660892:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115626.660945:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789115626.660950:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc333840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308296064:0@lo:400:kworker.0 00000100:00100000:1.0:1789115626.660972:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115626.661001:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308295936:0@lo:8:kworker.0 00000100:00100000:1.0:1789115626.661022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115626.661069:0:15542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308295808 00000100:00100000:1.0:1789115626.661076:0:15542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308295808 00000100:00100000:1.0:1789115626.661115:0:15542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308295936 00000100:00100000:1.0:1789115626.661118:0:15542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308295936 00000100:00100000:1.0:1789115626.661131:0:15542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789115626.661140:0:15542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc332580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308295808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115626.661476:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91237388-4e21-4f8d-88fa-5d733c21b708:3306:1876023308295680:0@lo:400:kworker.0 00000100:00100000:0.0:1789115626.661513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115626.661542:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc331680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308296320:0@lo:400:kworker.0 00000100:00100000:0.0:1789115626.661566:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115626.661585:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789115626.661591:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876023308296192:0@lo:400:kworker.0 00000100:00100000:0.0:1789115626.661612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115626.661643:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308295680 00000100:00100000:0.0:1789115626.661647:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308295680 00000100:00100000:0.0:1789115626.661680:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789115626.661688:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+19:3306:x1876023308295680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115626.661723:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+19:3306:x1876023308295680:12345-0@lo:400:kworker.0 Request processed in 36us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115626.661731:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789115626.661774:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308296064 00000100:00100000:0.0:1789115626.661779:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308296064 00000100:00100000:0.0:1789115626.661802:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308296320 00000100:00100000:0.0:1789115626.661805:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308296320 00000100:00100000:0.0:1789115626.661840:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308296192 00000100:00100000:0.0:1789115626.661843:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308296192 00000100:00100000:0.0:1789115626.661855:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789115626.661860:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc331e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308296064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115626.661907:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc331e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308296064:12345-0@lo:400:kworker.0 Request processed in 46us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115626.661914:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789115626.661925:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789115626.661932:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2570780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308296320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115626.661954:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2570780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876023308296320:12345-0@lo:400:kworker.0 Request processed in 24us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115626.661959:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789115626.661967:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789115626.661972:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2571a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876023308296192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115626.661990:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2571a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876023308296192:12345-0@lo:400:kworker.0 Request processed in 18us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115626.661995:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789115626.662014:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789115626.662255:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc330b40 x1876023308296192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115626.662271:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876023308296192:0@lo:400:kworker.0 00000100:00100000:0.0:1789115626.662284:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91237388-4e21-4f8d-88fa-5d733c21b708:3306:1876023308295680:0@lo:400:kworker.0 00010000:00080000:0.0:1789115626.662294:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc331680 x1876023308296320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115626.662302:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc331680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876023308296320:0@lo:400:kworker.0 00010000:00080000:0.0:1789115626.662336:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc333840 x1876023308296064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789115642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789115626.662358:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc333840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308296064:0@lo:400:kworker.0 00000100:00100000:1.0:1789115626.662488:0:15542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc332580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308295808:12345-0@lo:400:kworker.0 Request processed in 1347us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115626.662497:0:15542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789115626.662513:0:15542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789115626.662518:0:15542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc332d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1876023308295936:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789115626.662544:0:15542:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:1.0:1789115626.662571:0:15542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa47abda6516d4431 00002000:00100000:1.0:1789115626.662584:0:15542:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dfcc4d60800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398e ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789115626.662593:0:15542:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789115626.662596:0:15542:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789115626.662946:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308295808:0@lo:400:kworker.0 00002000:00080000:1.0:1789115626.663327:0:15542:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789115626.663355:0:15542:0:(import.c:65:import_set_state_nolock()) ffff8dfbc2276000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789115626.663456:0:15542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc332d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1876023308295936:12345-0@lo:8:kworker.0 Request processed in 935us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115626.663464:0:15542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789115626.668306:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc330000 x1876023308295936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789115651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789115626.668332:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789115626.668341:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789115626.668348:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789115626.668351:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dfcc4f4f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789115626.668400:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789115626.668408:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876023308295936:0@lo:8:kworker.0 00000004:00080000:1.0:1789115626.668672:0:14879:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789115626.668695:0:14879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14879:1876023308296576:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789115626.668758:0:14879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115626.668786:0:14879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd86fec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789115626.668803:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789115626.669178:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc332940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308296448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789115626.669209:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115626.669246:0:15545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308296448 00000100:00100000:1.0:1789115626.669252:0:15545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308296448 00000004:00080000:3.0:1789115626.669299:0:14878:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789115626.669309:0:15545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789115626.669318:0:15545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc333840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308296448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789115626.669351:0:15545:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789115626.669424:0:15545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc333840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308296448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115626.669431:0:15545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789115626.669474:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dfcfc332940 x1876023308296448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789115642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789115626.669490:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc332940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308296448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789115626.669513:0:15542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308296576 00000100:00100000:1.0:1789115626.669529:0:15542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308296576 00000100:00100000:1.0:1789115626.669570:0:15542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789115626.669577:0:15542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc3321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14879:x1876023308296576:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789115626.671028:0:14878:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 443883643157ns, next at 0ns, rc = 0 00002000:00080000:1.0:1789115626.678854:0:15542:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789115626.678865:0:15542:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789115626.678870:0:15542:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00080000:0.0:1789115626.681218:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1789115626.689752:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789115626.689762:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029062383/0xa47abda6516d4438 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.689778:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789115626.689783:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115626.689789:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029062383/0xa47abda6516d4438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.689805:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029062383/0xa47abda6516d4438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.689815:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029062383/0xa47abda6516d4438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.689822:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029062383/0xa47abda6516d4438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.689842:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789115626.690299:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789115626.690306:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a674027/0xa47abda6516d443f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.690321:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789115626.690324:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115626.690329:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a674027/0xa47abda6516d443f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.690339:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a674027/0xa47abda6516d443f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.690346:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a674027/0xa47abda6516d443f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.690354:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a674027/0xa47abda6516d443f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115626.693133:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789115626.693145:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029062383/0xa47abda6516d4438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115626.693159:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6c00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115626.693165:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029062383/0xa47abda6516d4438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115626.693176:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029062383/0xa47abda6516d4438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115626.693202:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029062383/0xa47abda6516d4438 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115626.693210:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029062383/0xa47abda6516d4438 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115626.693238:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789115626.693242:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a674027/0xa47abda6516d443f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115626.693249:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115626.693251:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a674027/0xa47abda6516d443f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115626.693273:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a674027/0xa47abda6516d443f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115626.693284:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a674027/0xa47abda6516d443f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115626.693293:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115626.693296:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115626.693299:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.696473:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789115626.698617:0:15542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a674027/0xa47abda6516d443f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.698694:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789115626.699411:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789115626.699419:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5c03433/0xa47abda6516d4446 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.699434:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789115626.699439:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115626.699444:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5c03433/0xa47abda6516d4446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.699464:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5c03433/0xa47abda6516d4446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.699475:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5c03433/0xa47abda6516d4446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.699495:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5c03433/0xa47abda6516d4446 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.699516:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789115626.699528:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115626.699534:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5c03433/0xa47abda6516d4446 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.699542:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6e00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115626.699546:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5c03433/0xa47abda6516d4446 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.699554:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5c03433/0xa47abda6516d4446 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.699573:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5c03433/0xa47abda6516d4446 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.699582:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5c03433/0xa47abda6516d4446 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.699607:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.699609:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.699612:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789115626.700046:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789115626.700053:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cce227cd/0xa47abda6516d444d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700062:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789115626.700067:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115626.700072:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cce227cd/0xa47abda6516d444d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700082:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cce227cd/0xa47abda6516d444d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700089:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cce227cd/0xa47abda6516d444d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700095:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cce227cd/0xa47abda6516d444d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700111:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789115626.700121:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115626.700126:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cce227cd/0xa47abda6516d444d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700144:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac7200 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115626.700148:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cce227cd/0xa47abda6516d444d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700156:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cce227cd/0xa47abda6516d444d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700167:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cce227cd/0xa47abda6516d444d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700174:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cce227cd/0xa47abda6516d444d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700188:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.700190:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.700191:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789115626.700730:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789115626.700737:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4454 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700746:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789115626.700750:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115626.700754:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4454 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700764:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4454 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700777:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4454 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700784:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4454 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.700801:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789115626.701154:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789115626.701160:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d445b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701168:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789115626.701171:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115626.701175:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d445b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701183:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d445b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701189:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d445b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701195:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d445b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701220:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789115626.701231:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789115626.701236:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4454 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701245:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ea00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115626.701249:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4454 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701257:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4454 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701270:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4454 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701277:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4454 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701295:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115626.701298:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d445b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701305:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115626.701307:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.701308:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d445b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701327:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d445b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701336:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d445b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701342:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d445b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.701352:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.701353:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.701355:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789115626.709429:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789115626.709442:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000921c5923/0xa47abda6516d4462 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.709459:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789115626.709464:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115626.709470:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000921c5923/0xa47abda6516d4462 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.709484:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000921c5923/0xa47abda6516d4462 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.709494:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000921c5923/0xa47abda6516d4462 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.709510:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000921c5923/0xa47abda6516d4462 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.709528:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789115626.709541:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115626.709548:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000921c5923/0xa47abda6516d4462 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.709557:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28f800 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115626.709562:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000921c5923/0xa47abda6516d4462 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.709573:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000921c5923/0xa47abda6516d4462 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.709593:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000921c5923/0xa47abda6516d4462 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.709601:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000921c5923/0xa47abda6516d4462 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.709619:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.709622:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.709623:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789115626.710066:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789115626.712922:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d497763/0xa47abda6516d4469 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.712939:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789115626.712944:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115626.712950:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d497763/0xa47abda6516d4469 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.712966:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d497763/0xa47abda6516d4469 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.712976:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d497763/0xa47abda6516d4469 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.712984:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d497763/0xa47abda6516d4469 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.713006:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789115626.713022:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115626.713028:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d497763/0xa47abda6516d4469 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.713036:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28fa00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115626.713041:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d497763/0xa47abda6516d4469 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.713050:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d497763/0xa47abda6516d4469 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.713075:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d497763/0xa47abda6516d4469 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.713083:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d497763/0xa47abda6516d4469 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.713103:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.713105:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.713107:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789115626.716486:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789115626.717250:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789115626.717262:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d4470 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.717280:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789115626.717285:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115626.717292:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d4470 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.717308:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d4470 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.717318:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d4470 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.717326:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d4470 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.719725:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789115626.720564:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789115626.720574:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4477 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.720591:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789115626.720597:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115626.720604:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4477 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.720617:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4477 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.720626:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4477 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.720632:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4477 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.723284:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789115626.723297:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d4470 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.723310:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115626.723543:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d4470 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.723557:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d4470 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.723584:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d4470 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.723611:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7c354ba/0xa47abda6516d4470 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.723634:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115626.723638:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4477 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.723645:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ea00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115626.723648:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4477 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.723656:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4477 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.723667:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4477 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.723674:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.723676:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.723678:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.726268:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.726279:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789115626.726292:0:15542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d4477 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789115626.728101:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789115626.728114:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d447e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.728136:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789115626.728141:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115626.728148:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d447e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.728165:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d447e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.728175:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d447e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.728183:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d447e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.728211:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789115626.728273:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115626.728283:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d447e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.728295:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e400 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115626.728306:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d447e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.728530:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d447e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.728553:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d447e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.728561:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007113008/0xa47abda6516d447e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.728583:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.728586:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.728588:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789115626.729246:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789115626.729255:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4485 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.729267:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789115626.729272:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115626.729278:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4485 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.729290:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4485 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.729313:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4485 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.729321:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4485 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.729350:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789115626.729528:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115626.729536:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4485 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.729544:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28fe00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115626.729549:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4485 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.730044:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4485 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.730065:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4485 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.730081:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4485 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.730100:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.730102:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.730104:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789115626.738183:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.738197:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060e76c54/0xa47abda6516d448c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.738214:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.738219:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.738226:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060e76c54/0xa47abda6516d448c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.738238:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060e76c54/0xa47abda6516d448c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.738247:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060e76c54/0xa47abda6516d448c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.738255:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060e76c54/0xa47abda6516d448c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.738316:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789115626.738985:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.738999:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d4493 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.739008:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.739012:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.739017:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d4493 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.739027:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d4493 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.739035:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d4493 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.739042:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d4493 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.742684:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789115626.742701:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060e76c54/0xa47abda6516d448c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.742794:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3a00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115626.742799:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060e76c54/0xa47abda6516d448c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.742931:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060e76c54/0xa47abda6516d448c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.742954:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060e76c54/0xa47abda6516d448c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.742961:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060e76c54/0xa47abda6516d448c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.742988:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115626.743015:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d4493 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.743023:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115626.743027:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d4493 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.743036:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d4493 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.743047:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d4493 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.743055:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.743057:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.743059:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.743169:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789115626.743178:0:15542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d4493 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789115626.747080:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.747094:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eb844a2/0xa47abda6516d449a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.747110:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.747115:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.747130:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eb844a2/0xa47abda6516d449a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.747146:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eb844a2/0xa47abda6516d449a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.747156:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eb844a2/0xa47abda6516d449a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.747164:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eb844a2/0xa47abda6516d449a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.747183:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789115626.747195:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115626.747201:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eb844a2/0xa47abda6516d449a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.747209:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2800 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115626.747214:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eb844a2/0xa47abda6516d449a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.747224:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eb844a2/0xa47abda6516d449a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.747240:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eb844a2/0xa47abda6516d449a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.747258:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eb844a2/0xa47abda6516d449a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.747273:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.747275:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.747276:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.747725:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789115626.748528:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.748538:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5da4455/0xa47abda6516d44a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.748551:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.748556:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.748561:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5da4455/0xa47abda6516d44a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.748573:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5da4455/0xa47abda6516d44a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.748865:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5da4455/0xa47abda6516d44a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.748874:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5da4455/0xa47abda6516d44a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.748889:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789115626.749430:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.749443:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d44a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.749453:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.749456:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.749461:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d44a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.749471:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d44a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.749480:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d44a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.749488:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d44a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.749504:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789115626.749516:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789115626.749521:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5da4455/0xa47abda6516d44a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.749529:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2c00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115626.749534:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5da4455/0xa47abda6516d44a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.749543:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5da4455/0xa47abda6516d44a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.749566:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5da4455/0xa47abda6516d44a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.749574:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5da4455/0xa47abda6516d44a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.749967:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115626.749974:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d44a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.749983:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2a00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115626.749986:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d44a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.749995:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d44a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.750021:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d44a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.750027:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d44a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.750044:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.750046:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.750048:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.750764:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.750766:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.750768:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789115626.751278:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.751286:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d44af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.751298:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.751302:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.751308:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d44af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.751319:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d44af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.751328:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d44af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.751336:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d44af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.751882:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789115626.752463:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.752471:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d44b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.752483:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.752487:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.752492:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d44b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.752503:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d44b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.752510:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d44b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.752517:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d44b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.752764:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789115626.752772:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d44af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.752781:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3c00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115626.752785:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d44af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.752794:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d44af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.752845:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d44af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.752853:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d44af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.752882:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115626.752885:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d44b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.752891:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115626.752895:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d44b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.752902:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d44b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.752912:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d44b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.752918:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.752919:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.752921:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.752987:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789115626.752993:0:15542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b922439/0xa47abda6516d44b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789115626.753479:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.753485:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e086d267/0xa47abda6516d44bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.753500:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.753504:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.753509:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e086d267/0xa47abda6516d44bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.753520:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e086d267/0xa47abda6516d44bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.753527:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e086d267/0xa47abda6516d44bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.753533:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e086d267/0xa47abda6516d44bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.755681:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115626.755699:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e086d267/0xa47abda6516d44bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.755879:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3200 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115626.755884:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e086d267/0xa47abda6516d44bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.755917:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e086d267/0xa47abda6516d44bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.755937:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e086d267/0xa47abda6516d44bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.755949:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.755951:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.755954:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.756095:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789115626.756103:0:15542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e086d267/0xa47abda6516d44bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789115626.756944:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.756953:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fceb12b2/0xa47abda6516d44c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.756965:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.756969:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.756976:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fceb12b2/0xa47abda6516d44c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.757002:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fceb12b2/0xa47abda6516d44c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.757013:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fceb12b2/0xa47abda6516d44c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.757021:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fceb12b2/0xa47abda6516d44c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.757183:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115626.757190:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fceb12b2/0xa47abda6516d44c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.757197:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3e00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115626.757201:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fceb12b2/0xa47abda6516d44c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.757210:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fceb12b2/0xa47abda6516d44c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.757224:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fceb12b2/0xa47abda6516d44c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.757233:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.757235:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.757237:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.757309:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789115626.757315:0:15542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fceb12b2/0xa47abda6516d44c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789115626.759332:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.759343:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022ec7fa9/0xa47abda6516d44cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.759358:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.759374:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.759398:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022ec7fa9/0xa47abda6516d44cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.759413:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022ec7fa9/0xa47abda6516d44cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.759436:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022ec7fa9/0xa47abda6516d44cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.759445:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022ec7fa9/0xa47abda6516d44cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.763086:0:14842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115626.763100:0:14842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022ec7fa9/0xa47abda6516d44cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.763115:0:14842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2600 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115626.763120:0:14842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022ec7fa9/0xa47abda6516d44cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.763132:0:14842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022ec7fa9/0xa47abda6516d44cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.763155:0:14842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022ec7fa9/0xa47abda6516d44cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.763167:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.763168:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.763170:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.764058:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789115626.764069:0:15542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022ec7fa9/0xa47abda6516d44cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.764881:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789115626.765723:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.765734:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d44d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.765750:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.765754:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.765760:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d44d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.765773:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d44d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.765781:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d44d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.766679:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d44d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.766713:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789115626.767306:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.767314:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095dac391/0xa47abda6516d44d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.767326:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.767330:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.767335:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095dac391/0xa47abda6516d44d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.767348:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095dac391/0xa47abda6516d44d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.767357:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095dac391/0xa47abda6516d44d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.769715:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789115626.769727:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d44d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.769741:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3600 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115626.769745:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d44d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.769755:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d44d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.769800:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d44d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.770070:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d44d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115626.770102:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.770104:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789115626.770106:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.770393:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095dac391/0xa47abda6516d44d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.770416:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789115626.772151:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.772164:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006018b767/0xa47abda6516d44e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.772185:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.772189:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.772196:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006018b767/0xa47abda6516d44e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.772211:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006018b767/0xa47abda6516d44e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.772221:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006018b767/0xa47abda6516d44e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.772229:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006018b767/0xa47abda6516d44e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.775836:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789115626.776676:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789115626.776688:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095dac391/0xa47abda6516d44d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789115626.776843:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.776852:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c31f878/0xa47abda6516d44e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.776867:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.776871:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.776879:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c31f878/0xa47abda6516d44e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.776894:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c31f878/0xa47abda6516d44e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.776916:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c31f878/0xa47abda6516d44e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.776924:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c31f878/0xa47abda6516d44e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.776945:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789115626.777378:0:15542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789115626.777404:0:15542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d44ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.777412:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789115626.777416:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115626.777419:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d44ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.777429:0:15542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d44ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.777436:0:15542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d44ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.777442:0:15542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d44ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115626.777463:0:15542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:0.0:1789115626.777637:0:15542:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1789115626.777738:0:15542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc3321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14879:x1876023308296576:12345-0@lo:5:osp-pre-1-0.0 Request processed in 108157us (108976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115626.777748:0:15542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789115626.778277:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2e00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:2.0:1789115626.778294:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095dac391/0xa47abda6516d44d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778322:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095dac391/0xa47abda6516d44d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778343:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095dac391/0xa47abda6516d44d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778351:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095dac391/0xa47abda6516d44d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778399:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789115626.778404:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006018b767/0xa47abda6516d44e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778412:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3800 already unused, calling callback (ffffffffc1728550) 00010000:00010000:2.0:1789115626.778415:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006018b767/0xa47abda6516d44e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778423:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006018b767/0xa47abda6516d44e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778433:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006018b767/0xa47abda6516d44e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778440:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006018b767/0xa47abda6516d44e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778476:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789115626.778480:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c31f878/0xa47abda6516d44e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778488:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3400 already unused, calling callback (ffffffffc1728550) 00010000:00010000:2.0:1789115626.778491:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c31f878/0xa47abda6516d44e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778508:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c31f878/0xa47abda6516d44e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778519:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c31f878/0xa47abda6516d44e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778527:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c31f878/0xa47abda6516d44e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778540:0:14843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789115626.778544:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d44ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778550:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2400 already unused, calling callback (ffffffffc1728550) 00010000:00010000:2.0:1789115626.778553:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d44ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778572:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d44ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778581:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d44ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778589:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d44ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115626.778602:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115626.778604:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115626.778606:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115626.779591:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115626.780019:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115626.780176:0:14879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14879:1876023308296576:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789115626.780195:0:14879:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789115626.780246:0:14879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14879:1876023308296704:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789115626.780301:0:14879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115626.780353:0:14879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc816b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789115626.780418:0:15540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308296704 00000100:00100000:2.0:1789115626.780426:0:15540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308296704 00000100:00100000:2.0:1789115626.780487:0:15540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789115626.780506:0:15540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc332940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14879:x1876023308296704:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789115626.780547:0:15540:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1789115626.793250:0:15540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc332940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14879:x1876023308296704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12748us (12942us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789115626.793265:0:15540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789115626.793281:0:14879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14879:1876023308296704:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789115626.793298:0:14879:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1789115626.988729:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789115627.289301:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789115627.289322:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:02000400:1.0:1789115627.842322:0:16620:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789115628.005690:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115629.029625:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115630.053724:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115630.136260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115630.136375:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288375936 00000100:00100000:1.0:1789115630.136424:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288375936 00000100:00100000:1.0:1789115630.136480:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:1.0:1789115630.136491:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2349:x1876023288375936:12345-192.168.203.31@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789115630.136530:0:14846:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 008edc47-34ab-4767-b919-a366055c99eb@192.168.203.31@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:1.0:1789115630.136568:0:14846:0:(genops.c:1385:class_connect()) connect: client 008edc47-34ab-4767-b919-a366055c99eb, cookie 0xa47abda6516d44f5 00000100:00080000:1.0:1789115630.136785:0:14846:0:(import.c:65:import_set_state_nolock()) ffff8dfbc2270800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789115630.136902:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+5:2349:x1876023288375936:12345-192.168.203.31@tcp:250:mount.lustre.0 Request processed in 412us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115630.136912:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:1.0:1789115630.149105:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115630.149214:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288376064 00000100:00100000:0.0:1789115630.149227:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288376064 00000100:00100000:0.0:1789115630.149305:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:0.0:1789115630.149324:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+5:13963:x1876023288376064:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789115630.149357:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115630.149417:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d44fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3eac expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115630.149455:0:14848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d44fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3eac expref: 6 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115630.149469:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfced9d2600/0xa47abda6516d44fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3eac expref: 6 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115630.149480:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d2600, rc 0) 00000100:00100000:0.0:1789115630.149548:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+6:13963:x1876023288376064:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 233us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115630.149556:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:2.0:1789115630.177822:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115630.180514:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288376192 00000100:00100000:0.0:1789115630.180561:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288376192 00000100:00100000:0.0:1789115630.180713:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:0.0:1789115630.180728:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf4f54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+6:13963:x1876023288376192:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789115630.181263:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf4f54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+6:13963:x1876023288376192:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 535us (3453us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789115630.181274:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:2.0:1789115630.184807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115630.190419:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288376320 00000100:00100000:1.0:1789115630.190439:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288376320 00000100:00100000:1.0:1789115630.190524:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:1.0:1789115630.190534:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+6:13963:x1876023288376320:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789115630.190556:0:14846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115630.190578:0:14846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d4503 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3eb3 expref: -99 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115630.190612:0:14846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d4503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3eb3 expref: 7 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115630.190625:0:14846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28e200/0xa47abda6516d4503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3eb3 expref: 7 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115630.190636:0:14846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e200, rc 0) 00000100:00100000:1.0:1789115630.191654:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+7:13963:x1876023288376320:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 1108us (6850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115630.191666:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:2.0:1789115630.195464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115630.195592:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288376448 00000100:00100000:0.0:1789115630.195604:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288376448 00000100:00100000:0.0:1789115630.195717:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:0.0:1789115630.195729:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+7:13963:x1876023288376448:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789115630.196100:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+8:13963:x1876023288376448:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 372us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115630.196109:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:2.0:1789115630.199348:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115630.199532:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288376576 00000100:00100000:1.0:1789115630.199545:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288376576 00000100:00100000:1.0:1789115630.199618:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:1.0:1789115630.199635:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+8:13963:x1876023288376576:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789115630.200134:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+8:13963:x1876023288376576:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 500us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115630.200143:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:2.0:1789115630.206427:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115630.208800:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288376704 00000100:00100000:0.0:1789115630.208821:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288376704 00000100:00100000:0.0:1789115630.209042:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:0.0:1789115630.209056:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+8:13982:x1876023288376704:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789115630.210289:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+8:13982:x1876023288376704:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 1225us (3910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115630.210304:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:0.0:1789115630.243685:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789115630.243723:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308296832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789115630.243839:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115630.243998:0:15545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308296832 00000100:00100000:3.0:1789115630.244010:0:15545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308296832 00000100:00100000:3.0:1789115630.244099:0:15545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789115630.244111:0:15545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308296832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789115630.244180:0:15545:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115630.244263:0:15545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308296832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115630.244272:0:15545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789115630.244332:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308296832:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789115630.245268:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789115630.260631:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115630.261456:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288376832 00000100:00100000:0.0:1789115630.261472:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288376832 00000100:00100000:0.0:1789115630.261541:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:0.0:1789115630.261553:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+8:13982:x1876023288376832:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789115630.263738:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+8:13982:x1876023288376832:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 2169us (3106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115630.263755:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:0.0:1789115630.273990:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115630.274613:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288376960 00000100:00100000:2.0:1789115630.274625:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288376960 00000100:00100000:2.0:1789115630.274695:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:2.0:1789115630.274707:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+8:13963:x1876023288376960:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789115630.274730:0:14849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115630.274756:0:14849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc1521600/0xa47abda6516d450a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3edd expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115630.274795:0:14849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1521600/0xa47abda6516d450a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3edd expref: 9 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115630.274809:0:14849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc1521600/0xa47abda6516d450a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3edd expref: 9 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115630.274821:0:14849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1521600, rc 0) 00000100:00100000:2.0:1789115630.274931:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+9:13963:x1876023288376960:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 226us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115630.274939:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:2.0:1789115630.281203:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115630.282206:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288377088 00000100:00100000:1.0:1789115630.282236:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288377088 00000100:00100000:1.0:1789115630.282317:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:1.0:1789115630.282330:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1189050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+9:13963:x1876023288377088:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789115630.282593:0:14848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789115630.282628:0:14848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789115630.282633:0:14848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789115630.282637:0:14848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789115630.282640:0:14848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789115630.288570:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1189050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+9:13963:x1876023288377088:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 6225us (7366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115630.288590:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:2.0:1789115630.293930:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115630.294193:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288377216 00000100:00100000:1.0:1789115630.294206:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288377216 00000100:00100000:1.0:1789115630.294422:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:1.0:1789115630.294435:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+9:13963:x1876023288377216:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789115630.294459:0:14846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115630.294486:0:14846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d4511 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3ee4 expref: -99 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115630.294549:0:14846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d4511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ee4 expref: 10 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115630.294563:0:14846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d4511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ee4 expref: 10 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115630.294575:0:14846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f400, rc 0) 00000100:00100000:1.0:1789115630.294656:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+10:13963:x1876023288377216:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 223us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115630.294664:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:2.0:1789115630.304764:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115630.305084:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288377344 00000100:00100000:1.0:1789115630.305096:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288377344 00000100:00100000:1.0:1789115630.305173:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:1.0:1789115630.305185:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+10:13963:x1876023288377344:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789115630.306776:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+10:13963:x1876023288377344:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 1580us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115630.306802:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:3.0:1789115630.315836:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115630.318301:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288377472 00000100:00100000:0.0:1789115630.318322:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288377472 00000100:00100000:0.0:1789115630.318443:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:0.0:1789115630.318456:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+10:13963:x1876023288377472:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789115630.318986:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+10:13963:x1876023288377472:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 530us (3163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115630.318997:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:2.0:1789115630.326838:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115630.328795:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288377600 00000100:00100000:1.0:1789115630.328814:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288377600 00000100:00100000:1.0:1789115630.328908:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:1.0:1789115630.328920:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+10:13986:x1876023288377600:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789115630.329359:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+10:13986:x1876023288377600:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 440us (2535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115630.329376:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:3.0:1789115630.336634:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115630.336853:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288377728 00000100:00100000:2.0:1789115630.336867:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288377728 00000100:00100000:2.0:1789115630.336946:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:2.0:1789115630.336958:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+10:13986:x1876023288377728:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789115630.337689:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+10:13986:x1876023288377728:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 726us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115630.337699:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:2.0:1789115630.355940:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115630.360478:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288377856 00000100:00100000:0.0:1789115630.360501:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288377856 00000100:00100000:0.0:1789115630.360587:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:0.0:1789115630.360598:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2349:x1876023288377856:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789115630.360635:0:14855:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from fed6308d-d83b-4b96-8e21-feae292eb9a7@192.168.203.31@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:0.0:1789115630.360704:0:14855:0:(genops.c:1385:class_connect()) connect: client fed6308d-d83b-4b96-8e21-feae292eb9a7, cookie 0xa47abda6516d4518 00000004:00100000:0.0:1789115630.360743:0:14855:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:0.0:1789115630.360751:0:14855:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1789115630.414742:0:14855:0:(import.c:65:import_set_state_nolock()) ffff8dfcfbf90800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789115630.414854:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:2349:x1876023288377856:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 54254us (58927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115630.414868:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1789115630.422581:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115630.422633:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115630.422746:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288377984 00000100:00100000:1.0:1789115630.422778:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288377984 00000100:00100000:1.0:1789115630.422868:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288378112 00000100:00100000:1.0:1789115630.422872:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288378112 00000100:00100000:1.0:1789115630.422898:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:1.0:1789115630.422910:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:0:x1876023288377984:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789115630.422969:0:14854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789115630.423082:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:0:x1876023288377984:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 173us (517us total) trans 0 rc 0/0 00000100:00080000:0.0:1789115630.423443:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115630.423576:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1789115630.423601:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc0983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:13963:x1876023288378112:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789115630.423625:0:14856:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789115630.423663:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc0983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:13963:x1876023288378112:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 67us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115630.423672:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:1.0:1789115630.423772:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1789115630.426775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115630.426913:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288378240 00000100:00100000:2.0:1789115630.426925:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288378240 00000100:00100000:2.0:1789115630.427050:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1789115630.427064:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc098780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:13963:x1876023288378240:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789115630.427189:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc098780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:13963:x1876023288378240:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 129us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115630.427197:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1789115630.433623:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115630.433732:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115630.433785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115630.433993:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288378368 00000100:00100000:1.0:1789115630.434005:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288378368 00000100:00100000:1.0:1789115630.434054:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288378496 00000100:00100000:1.0:1789115630.434058:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288378496 00000100:00100000:1.0:1789115630.434076:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:1.0:1789115630.434095:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5739e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1876023288378368:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789115630.434139:0:15543:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from fed6308d-d83b-4b96-8e21-feae292eb9a7@192.168.203.31@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:1.0:1789115630.434183:0:15543:0:(genops.c:1385:class_connect()) connect: client fed6308d-d83b-4b96-8e21-feae292eb9a7, cookie 0xa47abda6516d451f 00002000:00100000:1.0:1789115630.434199:0:15543:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fed6308d-d83b-4b96-8e21-feae292eb9a7/ffff8dfcffb2d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789115630.434212:0:15543:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789115630.434987:0:15543:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789115630.435039:0:15543:0:(import.c:65:import_set_state_nolock()) ffff8dfcffb2c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789115630.435170:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5739e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:2349:x1876023288378368:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 1082us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115630.435182:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:1.0:1789115630.435221:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:1.0:1789115630.435479:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1876023288378496:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789115630.435526:0:15543:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from fed6308d-d83b-4b96-8e21-feae292eb9a7@192.168.203.31@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:1.0:1789115630.435557:0:15543:0:(genops.c:1385:class_connect()) connect: client fed6308d-d83b-4b96-8e21-feae292eb9a7, cookie 0xa47abda6516d4526 00002000:00100000:1.0:1789115630.435569:0:15543:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fed6308d-d83b-4b96-8e21-feae292eb9a7/ffff8dfcffb2a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789115630.435592:0:15543:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789115630.435891:0:15543:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789115630.435919:0:15543:0:(import.c:65:import_set_state_nolock()) ffff8dfcc70be800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789115630.435958:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:2349:x1876023288378496:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 728us (2172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115630.435966:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1789115630.437013:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288378624 00000100:00100000:3.0:1789115630.437031:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288378624 00000100:00100000:3.0:1789115630.437103:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1789115630.437114:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5738b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:13963:x1876023288378624:12345-192.168.203.31@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789115630.438677:0:14857:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1466us 00000004:00200000:1.0:1789115630.456511:0:14857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1789115630.456733:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5738b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:13963:x1876023288378624:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 19612us (23118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115630.456756:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:2.0:1789115630.651448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115630.651588:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288378752 00000100:00100000:1.0:1789115630.651601:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288378752 00000100:00100000:1.0:1789115630.651686:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:1.0:1789115630.651699:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:14009:x1876023288378752:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:1.0:1789115630.651729:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115630.651769:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d452d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3f0e expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115630.651865:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e800/0xa47abda6516d4534 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115630.651882:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e800/0xa47abda6516d4534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115630.651914:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e800/0xa47abda6516d4534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115630.652212:0:16274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789115630.652218:0:16274:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115630.652331:0:16274:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e800/0xa47abda6516d4534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115630.652378:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d452d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f0e expref: 8 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115630.652448:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e800/0xa47abda6516d4534 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f0e expref: 7 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115630.652457:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:1.0:1789115630.652460:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789115630.652464:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28e800, rc 0) 00000100:00100000:1.0:1789115630.652542:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:14009:x1876023288378752:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 846us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115630.652550:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00010000:00010000:3.0:1789115631.075666:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115631.779713:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc57383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91237388-4e21-4f8d-88fa-5d733c21b708:3305:1876023308297088:0@lo:400:kworker.0 00000100:00100000:0.0:1789115631.779837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115631.780350:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308297472:0@lo:400:kworker.0 00000100:00100000:0.0:1789115631.780442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115631.780466:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789115631.780472:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308296960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789115631.780500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115631.780658:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc5738f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308297216:0@lo:400:kworker.0 00000100:00100000:0.0:1789115631.780690:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115631.780729:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789115631.780735:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308297344:0@lo:400:kworker.0 00000100:00100000:0.0:1789115631.780754:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115631.780782:0:15542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308297216 00000100:00100000:0.0:1789115631.780805:0:15542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308297216 00000100:00100000:0.0:1789115631.780861:0:15542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308297344 00000100:00100000:0.0:1789115631.780864:0:15542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308297344 00000100:00100000:0.0:1789115631.780894:0:15542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789115631.780902:0:15542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2573c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308297216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115631.780956:0:15542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2573c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308297216:12345-0@lo:400:kworker.0 Request processed in 55us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115631.780964:0:15542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789115631.780982:0:15542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789115631.780988:0:15542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2571680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308297344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115631.781012:0:15542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2571680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308297344:12345-0@lo:400:kworker.0 Request processed in 25us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115631.781018:0:15542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789115631.781039:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789115631.781068:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789115631.781092:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308297344:0@lo:400:kworker.0 00000100:00100000:0.0:1789115631.781364:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308297216:0@lo:400:kworker.0 00000100:00100000:0.0:1789115631.781441:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308297472 00000100:00100000:0.0:1789115631.781446:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308297472 00000100:00100000:0.0:1789115631.781483:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789115631.781490:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2572580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308297472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115631.781535:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2572580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308297472:12345-0@lo:400:kworker.0 Request processed in 46us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115631.781555:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789115631.781589:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc5738780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308297472:0@lo:400:kworker.0 00000100:00100000:0.0:1789115631.781653:0:15545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308296960 00000100:00100000:0.0:1789115631.781656:0:15545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308296960 00000100:00100000:0.0:1789115631.781680:0:15545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789115631.781685:0:15545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2570b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308296960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115631.781702:0:15545:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115631.781738:0:15545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2570b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308296960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115631.781744:0:15545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789115631.781771:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308296960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115631.783964:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308297088 00000100:00100000:3.0:1789115631.783982:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308297088 00000100:00100000:3.0:1789115631.784234:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789115631.784246:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+19:3305:x1876023308297088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115631.784374:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+19:3305:x1876023308297088:12345-0@lo:400:kworker.0 Request processed in 130us (4536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115631.784400:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789115631.784538:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc57383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91237388-4e21-4f8d-88fa-5d733c21b708:3305:1876023308297088:0@lo:400:kworker.0 00000100:00100000:0.0:1789115631.786504:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876023308297600:0@lo:400:kworker.0 00000100:00100000:2.0:1789115631.786543:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789115631.786562:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc573a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876023308297728:0@lo:400:kworker.0 00000100:00100000:2.0:1789115631.790420:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115631.790586:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308297728 00000100:00100000:2.0:1789115631.790596:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308297728 00000100:00100000:2.0:1789115631.790682:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789115631.790694:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc57383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876023308297728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115631.790802:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc57383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876023308297728:12345-0@lo:400:kworker.0 Request processed in 110us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115631.790810:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789115631.790871:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876023308297728:0@lo:400:kworker.0 00000100:00080000:2.0:1789115631.790899:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115631.794409:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115631.798825:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308297600 00000100:00100000:1.0:1789115631.798846:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308297600 00000100:00100000:1.0:1789115631.798972:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789115631.798985:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc25712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876023308297600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789115631.799117:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc25712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876023308297600:12345-0@lo:400:kworker.0 Request processed in 135us (4736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115631.799126:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789115631.799909:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115631.799972:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc573bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876023308297600:0@lo:400:kworker.0 00010000:00010000:0.0:1789115632.102536:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789115632.364128:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fed6308d-d83b-4b96-8e21-feae292eb9a7 00000100:00100000:3.0:1789115632.818540:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115632.818615:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288378880 00000100:00100000:2.0:1789115632.818630:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288378880 00000100:00080000:0.0:1789115632.818769:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115632.818798:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1789115632.818812:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:14061:x1876023288378880:12345-192.168.203.31@tcp:41:lfs.0 00000004:00000024:2.0:1789115632.818856:0:16274:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789115632.818959:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:14061:x1876023288378880:12345-192.168.203.31@tcp:41:lfs.0 Request processed in 150us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115632.818968:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:0.0:1789115632.823616:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115632.823819:0:15545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288379008 00000100:00100000:3.0:1789115632.823832:0:15545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288379008 00000100:00100000:3.0:1789115632.823924:0:15545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1789115632.823936:0:15545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc25730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:14061:x1876023288379008:12345-192.168.203.31@tcp:13:lfs.0 00002000:00000024:3.0:1789115632.823985:0:15545:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115632.824208:0:15545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc25730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:14061:x1876023288379008:12345-192.168.203.31@tcp:13:lfs.0 Request processed in 274us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115632.824239:0:15545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00080000:0.0:1789115632.824541:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789115632.829069:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115632.829452:0:15545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288379136 00000100:00100000:3.0:1789115632.829466:0:15545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288379136 00000100:00100000:3.0:1789115632.829620:0:15545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1789115632.829633:0:15545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:14061:x1876023288379136:12345-192.168.203.31@tcp:13:lfs.0 00002000:00000024:3.0:1789115632.829689:0:15545:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115632.829833:0:15545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:14061:x1876023288379136:12345-192.168.203.31@tcp:13:lfs.0 Request processed in 203us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115632.829842:0:15545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00080000:0.0:1789115632.835068:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789115633.017740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115633.018722:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288379264 00000100:00100000:2.0:1789115633.018739:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288379264 00000100:00100000:2.0:1789115633.020088:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:2.0:1789115633.020117:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc118a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+10:14091:x1876023288379264:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789115633.020142:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115633.020188:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc1520c00/0xa47abda6516d453b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3f15 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.020233:0:14848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1520c00/0xa47abda6516d453b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f15 expref: 11 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.020247:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc1520c00/0xa47abda6516d453b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f15 expref: 11 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.020259:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1520c00, rc 0) 00000100:00100000:2.0:1789115633.020370:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc118a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+11:14091:x1876023288379264:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 267us (2645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115633.020379:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:1.0:1789115633.030522:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115633.030790:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288379392 00000100:00100000:3.0:1789115633.030803:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288379392 00000100:00100000:3.0:1789115633.031001:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:3.0:1789115633.031014:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc1188050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+11:14091:x1876023288379392:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789115633.031774:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc1188050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+11:14091:x1876023288379392:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 759us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115633.031785:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:0.0:1789115633.044030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115633.044141:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288379520 00000100:00100000:2.0:1789115633.044153:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288379520 00000100:00100000:2.0:1789115633.044215:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:2.0:1789115633.044225:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+11:14091:x1876023288379520:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789115633.044781:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+11:14091:x1876023288379520:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 555us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115633.044791:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:1.0:1789115633.059070:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115633.059180:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288379648 00000100:00100000:3.0:1789115633.059192:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288379648 00000100:00100000:3.0:1789115633.059258:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:3.0:1789115633.059270:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+11:14099:x1876023288379648:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789115633.059879:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+11:14099:x1876023288379648:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 609us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115633.059889:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:0.0:1789115633.096145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115633.096272:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288379776 00000100:00100000:1.0:1789115633.096285:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288379776 00000100:00100000:1.0:1789115633.096370:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:1.0:1789115633.096515:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+11:14099:x1876023288379776:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789115633.097149:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+11:14099:x1876023288379776:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 767us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115633.097159:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:0.0:1789115633.110179:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115633.113527:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288379904 00000100:00100000:2.0:1789115633.113858:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288379904 00000100:00100000:2.0:1789115633.114031:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:2.0:1789115633.114044:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+11:14091:x1876023288379904:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789115633.114065:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115633.114090:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc1521800/0xa47abda6516d4542 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3f3f expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.114162:0:14848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1521800/0xa47abda6516d4542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f3f expref: 12 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.114174:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc1521800/0xa47abda6516d4542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f3f expref: 12 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.114186:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1521800, rc 0) 00000100:00100000:2.0:1789115633.114274:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+12:14091:x1876023288379904:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 234us (4111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115633.114282:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00010000:00010000:2.0:1789115633.123778:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115633.125682:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115633.126538:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288380032 00000100:00100000:1.0:1789115633.126621:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288380032 00000100:00100000:1.0:1789115633.126714:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:1.0:1789115633.126726:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+12:14091:x1876023288380032:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789115633.126765:0:14849:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789115633.126857:0:14849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789115633.126864:0:14849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789115633.126868:0:14849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789115633.126871:0:14849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789115633.134755:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+12:14091:x1876023288380032:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 8012us (9065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115633.134775:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:1.0:1789115633.147134:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115633.147286:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288380160 00000100:00100000:2.0:1789115633.147301:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288380160 00000100:00100000:2.0:1789115633.147441:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:2.0:1789115633.147454:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+12:14091:x1876023288380160:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789115633.147480:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115633.147507:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d4549 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3f46 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.147566:0:14848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d4549 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f46 expref: 13 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.147579:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d4549 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f46 expref: 13 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.147590:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1520000, rc 0) 00000100:00100000:2.0:1789115633.147690:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+13:14091:x1876023288380160:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 238us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115633.147699:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:3.0:1789115633.151034:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115633.151282:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288380288 00000100:00100000:1.0:1789115633.151296:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288380288 00000100:00100000:1.0:1789115633.151379:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:1.0:1789115633.151446:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+13:14091:x1876023288380288:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789115633.152163:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+13:14091:x1876023288380288:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 718us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115633.152174:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:1.0:1789115633.157951:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115633.161533:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288380416 00000100:00100000:3.0:1789115633.161620:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288380416 00000100:00100000:3.0:1789115633.161794:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:3.0:1789115633.161818:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+13:14091:x1876023288380416:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789115633.162168:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+13:14091:x1876023288380416:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 353us (4231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115633.162178:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:0.0:1789115633.167802:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115633.168016:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288380544 00000100:00100000:1.0:1789115633.168028:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288380544 00000100:00100000:1.0:1789115633.168095:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:1.0:1789115633.168108:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+13:14104:x1876023288380544:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789115633.168504:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+13:14104:x1876023288380544:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 397us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115633.168514:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:1.0:1789115633.181506:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115633.181991:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288380672 00000100:00100000:3.0:1789115633.182006:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288380672 00000100:00100000:3.0:1789115633.182140:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:3.0:1789115633.182153:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+13:14104:x1876023288380672:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789115633.183935:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+13:14104:x1876023288380672:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 1769us (2429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115633.183952:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:0.0:1789115633.195093:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115633.195218:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115633.195273:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115633.195355:0:15542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288381312 00000100:00100000:2.0:1789115633.195367:0:15542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288381312 00000100:00100000:2.0:1789115633.195511:0:15542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1789115633.195522:0:15542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:2352:x1876023288381312:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115633.195628:0:15542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:2352:x1876023288381312:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 108us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115633.195638:0:15542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1789115633.199065:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115633.199465:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288380800 00000100:00100000:1.0:1789115633.199480:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288380800 00000100:00100000:0.0:1789115633.199667:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288381440 00000100:00100000:0.0:1789115633.199673:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288381440 00000100:00100000:2.0:1789115633.199769:0:15542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:2.0:1789115633.199783:0:15542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2352:x1876023288381440:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115633.201954:0:15543:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789115633.201987:0:15543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789115633.202999:0:15542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2352:x1876023288381440:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 3207us (3939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115633.203015:0:15542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:1.0:1789115633.204585:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288381184 00000100:00100000:1.0:1789115633.204604:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288381184 00000100:00100000:2.0:1789115633.205079:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1789115633.205109:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:2352:x1876023288381184:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115633.205235:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:2352:x1876023288381184:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 144us (9960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115633.205256:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1789115633.205283:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1789115633.205289:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2349:x1876023288380800:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789115633.205315:0:14855:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 35b98319-ecbc-48a4-98d6-b960fe7c7d67@192.168.203.31@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:2.0:1789115633.205562:0:14855:0:(genops.c:1385:class_connect()) connect: client 35b98319-ecbc-48a4-98d6-b960fe7c7d67, cookie 0xa47abda6516d4550 00000004:00100000:2.0:1789115633.205604:0:14855:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1789115633.205977:0:14855:0:(import.c:65:import_set_state_nolock()) ffff8dfcc5def000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789115633.206208:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:2349:x1876023288380800:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 916us (11131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115633.206216:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1789115633.225596:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115633.225655:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115633.225892:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288380928 00000100:00100000:3.0:1789115633.225905:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288380928 00000100:00100000:2.0:1789115633.225910:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288381056 00000100:00100000:2.0:1789115633.225917:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288381056 00000100:00080000:0.0:1789115633.225998:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115633.226046:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:2.0:1789115633.226060:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+7:14091:x1876023288381056:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789115633.226105:0:14855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789115633.226209:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+7:14091:x1876023288381056:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 152us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115633.226219:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:2.0:1789115633.226256:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:2.0:1789115633.226264:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:0:x1876023288380928:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789115633.226276:0:14855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789115633.226299:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:0:x1876023288380928:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 37us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115633.226306:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:2.0:1789115633.236215:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115633.238682:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288381568 00000100:00100000:3.0:1789115633.238702:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288381568 00000100:00100000:3.0:1789115633.238803:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:3.0:1789115633.238815:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5738780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:14091:x1876023288381568:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789115633.239137:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5738780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:14091:x1876023288381568:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 323us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115633.239147:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1789115633.248059:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115633.248112:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115633.248147:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115633.248228:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288381696 00000100:00100000:2.0:1789115633.248253:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288381696 00000100:00100000:2.0:1789115633.248310:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288381824 00000100:00100000:2.0:1789115633.248314:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288381824 00000100:00100000:2.0:1789115633.248366:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1789115633.248373:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288381952 00000100:00100000:1.0:1789115633.248414:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288381952 00000100:00100000:2.0:1789115633.248433:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1876023288381696:12345-192.168.203.31@tcp:8:mount.lustre.0 00000100:00100000:1.0:1789115633.248462:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1789115633.248471:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:14091:x1876023288381952:12345-192.168.203.31@tcp:33:mount.lustre.0 00010000:00080000:2.0:1789115633.248593:0:15543:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 35b98319-ecbc-48a4-98d6-b960fe7c7d67@192.168.203.31@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:2.0:1789115633.248642:0:15543:0:(genops.c:1385:class_connect()) connect: client 35b98319-ecbc-48a4-98d6-b960fe7c7d67, cookie 0xa47abda6516d4557 00002000:00100000:2.0:1789115633.248657:0:15543:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 35b98319-ecbc-48a4-98d6-b960fe7c7d67/ffff8dfcc5dea000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789115633.248674:0:15543:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1789115633.248833:0:15543:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000004:00200000:1.0:1789115633.248846:0:14858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00080000:2.0:1789115633.248878:0:15543:0:(import.c:65:import_set_state_nolock()) ffff8dfcc5dee000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789115633.249024:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:14091:x1876023288381952:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 553us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115633.249034:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1789115633.249103:0:15542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1789115633.249109:0:15542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1876023288381824:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789115633.249137:0:15542:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 35b98319-ecbc-48a4-98d6-b960fe7c7d67@192.168.203.31@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:1.0:1789115633.249157:0:15542:0:(genops.c:1385:class_connect()) connect: client 35b98319-ecbc-48a4-98d6-b960fe7c7d67, cookie 0xa47abda6516d455e 00002000:00100000:1.0:1789115633.249164:0:15542:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35b98319-ecbc-48a4-98d6-b960fe7c7d67/ffff8dfcf532b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789115633.249171:0:15542:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789115633.249341:0:15542:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789115633.249361:0:15542:0:(import.c:65:import_set_state_nolock()) ffff8dfcf5328800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789115633.249426:0:15542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:2349:x1876023288381824:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 314us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115633.249433:0:15542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:2.0:1789115633.250063:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:2349:x1876023288381696:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 1628us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115633.250073:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000001:00100000:0.0:1789115633.395020:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fed6308d-d83b-4b96-8e21-feae292eb9a7 00000001:00100000:0.0:1789115633.395037:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35b98319-ecbc-48a4-98d6-b960fe7c7d67 00000100:00100000:0.0:1789115633.471343:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115633.471497:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288382080 00000100:00100000:2.0:1789115633.471516:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288382080 00000100:00100000:2.0:1789115633.471583:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1789115633.471594:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:14126:x1876023288382080:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:2.0:1789115633.471617:0:14855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115633.471643:0:14855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d4565 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3f70 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.471712:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d456c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.471727:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d456c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.471741:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d456c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115633.471959:0:14855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789115633.471964:0:14855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1789115633.472050:0:14855:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d456c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.472079:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d4565 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f70 expref: 8 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.472095:0:14855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d456c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f70 expref: 7 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115633.472105:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:2.0:1789115633.472108:0:14855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789115633.472111:0:14855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1521400, rc 0) 00000100:00100000:2.0:1789115633.472176:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+7:14126:x1876023288382080:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 584us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115633.472184:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00010000:00010000:3.0:1789115634.148426:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115635.171608:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115635.363780:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308297856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789115635.363841:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115635.363994:0:15545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308297856 00000100:00100000:3.0:1789115635.364003:0:15545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308297856 00000100:00100000:3.0:1789115635.364087:0:15545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789115635.364097:0:15545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc5738f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308297856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789115635.364134:0:15545:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789115635.364171:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789115635.364247:0:15545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc5738f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308297856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115635.364255:0:15545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789115635.366695:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308297856:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789115635.965899:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fed6308d-d83b-4b96-8e21-feae292eb9a7 00000001:00100000:3.0:1789115635.965955:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35b98319-ecbc-48a4-98d6-b960fe7c7d67 00010000:00010000:2.0:1789115636.195810:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789115636.532849:0:16825:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:2.0:1789115636.648674:0:14889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789115636.899832:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308298368:0@lo:400:kworker.0 00000100:00100000:1.0:1789115636.899900:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115636.899959:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789115636.900121:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308298368 00000100:00100000:3.0:1789115636.900130:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308298368 00000100:00100000:3.0:1789115636.900195:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789115636.900207:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308298368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115636.900269:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876023308298368:12345-0@lo:400:kworker.0 Request processed in 64us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115636.900278:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789115636.900363:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc3303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91237388-4e21-4f8d-88fa-5d733c21b708:3305:1876023308297984:0@lo:400:kworker.0 00000100:00100000:2.0:1789115636.900419:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115636.900455:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc331680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308298496:0@lo:400:kworker.0 00000100:00100000:2.0:1789115636.900478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115636.900512:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789115636.900529:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308298112:0@lo:400:kworker.0 00000100:00100000:2.0:1789115636.900557:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115636.900576:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308298624:0@lo:400:kworker.0 00000100:00100000:2.0:1789115636.900598:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115636.900623:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308298496 00000100:00100000:2.0:1789115636.900626:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308298496 00000100:00100000:2.0:1789115636.900659:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308298624 00000100:00100000:2.0:1789115636.900662:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308298624 00000100:00100000:2.0:1789115636.900684:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789115636.900690:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308298496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115636.900727:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876023308298496:12345-0@lo:400:kworker.0 Request processed in 37us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115636.900733:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789115636.900747:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789115636.900753:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308298624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115636.900781:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308298624:12345-0@lo:400:kworker.0 Request processed in 28us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115636.900787:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789115636.900824:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308298624:0@lo:400:kworker.0 00000100:00100000:2.0:1789115636.900833:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc331680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876023308298496:0@lo:400:kworker.0 00000100:00100000:2.0:1789115636.900867:0:15542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308298112 00000100:00100000:2.0:1789115636.900870:0:15542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308298112 00000100:00100000:2.0:1789115636.900899:0:15542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789115636.900906:0:15542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc573bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308298112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115636.900940:0:15542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc573bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308298112:12345-0@lo:400:kworker.0 Request processed in 34us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115636.900953:0:15542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789115636.900998:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308298112:0@lo:400:kworker.0 00000100:00100000:3.0:1789115636.901251:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308297984 00000100:00100000:3.0:1789115636.901255:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308297984 00000100:00100000:3.0:1789115636.901288:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789115636.901304:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+19:3305:x1876023308297984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115636.901342:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+19:3305:x1876023308297984:12345-0@lo:400:kworker.0 Request processed in 47us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115636.901347:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789115636.901435:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc3303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91237388-4e21-4f8d-88fa-5d733c21b708:3305:1876023308297984:0@lo:400:kworker.0 00000100:00100000:1.0:1789115636.901585:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308298240:0@lo:400:kworker.0 00000100:00100000:1.0:1789115636.901617:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115636.901647:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876023308298368:0@lo:400:kworker.0 00000100:00080000:0.0:1789115636.901833:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115636.901886:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308298240 00000100:00100000:2.0:1789115636.901890:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308298240 00000100:00100000:2.0:1789115636.901939:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789115636.901947:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308298240:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789115636.902135:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789115636.902198:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308298240:12345-0@lo:400:kworker.0 Request processed in 251us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115636.902205:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789115636.902334:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308298240:0@lo:400:kworker.0 00000100:00100000:3.0:1789115636.902459:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308298752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115636.902496:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115636.902563:0:15545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308298752 00000100:00100000:0.0:1789115636.902567:0:15545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308298752 00000100:00100000:0.0:1789115636.902603:0:15545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789115636.902611:0:15545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308298752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789115636.902641:0:15545:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115636.904558:0:15545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308298752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1939us (2052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115636.904592:0:15545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789115636.905355:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308298752:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789115637.219580:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789115637.450908:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35b98319-ecbc-48a4-98d6-b960fe7c7d67 00010000:00010000:0.0:1789115638.244886:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115638.246167:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115638.246210:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115638.246246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115638.246279:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115638.246316:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115638.246336:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115638.246353:0:15542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288382592 00000100:00100000:0.0:1789115638.246361:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115638.246365:0:15542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288382592 00000100:00100000:0.0:1789115638.246395:0:15540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288382848 00000100:00100000:0.0:1789115638.246399:0:15540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288382848 00000100:00100000:0.0:1789115638.246450:0:15540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288382464 00000100:00100000:0.0:1789115638.246453:0:15540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288382464 00000100:00100000:2.0:1789115638.246752:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288382336 00000100:00100000:2.0:1789115638.246757:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288382336 00000100:00100000:2.0:1789115638.246790:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288382720 00000100:00100000:2.0:1789115638.246793:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288382720 00000100:00100000:2.0:1789115638.246818:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1789115638.246829:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:2350:x1876023288382336:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115638.246926:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:2350:x1876023288382336:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 99us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115638.246935:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1789115638.246955:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1789115638.246962:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:2350:x1876023288382720:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115638.246988:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:2350:x1876023288382720:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115638.247005:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1789115638.254972:0:15542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288382976 00000100:00100000:3.0:1789115638.254992:0:15542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288382976 00000100:00100000:3.0:1789115638.255056:0:15542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1789115638.255070:0:15542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+5:2350:x1876023288382848:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115638.255175:0:15542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+5:2350:x1876023288382848:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 108us (8927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115638.255183:0:15542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1789115638.255205:0:15542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1789115638.255212:0:15542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2350:x1876023288382592:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115638.255240:0:15542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2350:x1876023288382592:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (9030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115638.255246:0:15542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1789115638.255262:0:15542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1789115638.255268:0:15542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+5:2350:x1876023288382976:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115638.255308:0:15542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+5:2350:x1876023288382976:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 40us (8945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115638.255314:0:15542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1789115638.255921:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288382208 00000100:00100000:3.0:1789115638.255928:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288382208 00000100:00100000:0.0:1789115638.255954:0:15540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:3.0:1789115638.255957:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:3.0:1789115638.255963:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+13:2350:x1876023288382208:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1789115638.255964:0:15540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2350:x1876023288382464:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:1.0:1789115638.258064:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789115638.258075:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789115638.258079:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789115638.262009:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+13:2350:x1876023288382208:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 6025us (15709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115638.262046:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:1.0:1789115638.269954:0:15540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2350:x1876023288382464:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 13971us (23617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115638.269974:0:15540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00010000:00010000:2.0:1789115639.267540:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789115640.173318:0:16976:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1055cb50 20000000:00000080:3.0:1789115640.173339:0:16976:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dfbc28d8400 uarg=0000000000000000 20000000:01000000:3.0:1789115640.173374:0:16976:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789115640.173524:0:16976:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789115640.173529:0:16976:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789115640.174296:0:16977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789115640.174621:0:16976:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789115640.184577:0:16976:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789115640.184607:0:16976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115640.184624:0:16976:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfced9d3000/0xa47abda6516d426a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d4263 expref: 18 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115640.184632:0:16976:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcedacd800/0xa47abda6516d42b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d42b0 expref: 18 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115640.184640:0:16976:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d43f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d43eb expref: 18 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115640.184649:0:16976:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d4511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ee4 expref: 12 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115640.184656:0:16976:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d4549 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f46 expref: 12 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115640.184663:0:16976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115640.184705:0:16976:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d4549 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f46 expref: 12 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115640.184731:0:16976:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d4549 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f46 expref: 12 pid: 14848 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115640.184746:0:16976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16976:1876023308298880:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789115640.184859:0:16976:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d4511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ee4 expref: 12 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115640.184869:0:16976:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d4511 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ee4 expref: 12 pid: 14846 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115640.184877:0:16976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16976:1876023308299008:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789115640.184909:0:16976:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d43f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d43eb expref: 18 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115640.184918:0:16976:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d43f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d43eb expref: 18 pid: 14848 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115640.184927:0:16976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf85e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16976:1876023308299136:0@lo:104: 00000100:00100000:3.0:1789115640.184965:0:16976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789115640.185000:0:16976:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfcedacd800/0xa47abda6516d42b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d42b0 expref: 18 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115640.185008:0:16976:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfcedacd800/0xa47abda6516d42b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d42b0 expref: 18 pid: 14849 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115640.185016:0:16976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf86940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16976:1876023308299264:0@lo:104: 00000100:00100000:3.0:1789115640.185037:0:16976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789115640.185070:0:16976:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dfced9d3000/0xa47abda6516d426a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa47abda6516d4263 expref: 18 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115640.185077:0:16976:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dfced9d3000/0xa47abda6516d426a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa47abda6516d4263 expref: 18 pid: 14846 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115640.185085:0:16976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf85680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16976:1876023308299392:0@lo:104: 00000100:00100000:3.0:1789115640.185108:0:16976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115640.185118:0:16976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd97196c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115640.185348:0:14838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789115640.185363:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308299136 00000100:00100000:2.0:1789115640.185370:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308299136 00000100:00100000:2.0:1789115640.185430:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308299264 00000100:00100000:2.0:1789115640.185433:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308299264 00000100:00100000:2.0:1789115640.185444:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308299392 00000100:00100000:2.0:1789115640.185447:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308299392 00000100:00100000:2.0:1789115640.185458:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789115640.185465:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf86580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91237388-4e21-4f8d-88fa-5d733c21b708+5:16976:x1876023308299136:12345-0@lo:104: 00010000:00010000:2.0:1789115640.185476:0:14838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d43f2 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185539:0:14838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789115640.185544:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf86580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91237388-4e21-4f8d-88fa-5d733c21b708+5:16976:x1876023308299136:12345-0@lo:104: Request processed in 80us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115640.185551:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789115640.185568:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789115640.185574:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91237388-4e21-4f8d-88fa-5d733c21b708+4:16976:x1876023308299264:12345-0@lo:104: 00010000:00010000:2.0:1789115640.185581:0:14838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d42b7 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185613:0:14838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789115640.185618:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91237388-4e21-4f8d-88fa-5d733c21b708+4:16976:x1876023308299264:12345-0@lo:104: Request processed in 45us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115640.185623:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789115640.185636:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789115640.185652:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcf5196450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91237388-4e21-4f8d-88fa-5d733c21b708+3:16976:x1876023308299392:12345-0@lo:104: 00010000:00010000:2.0:1789115640.185659:0:14838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d426a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185689:0:14838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789115640.185693:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcf5196450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91237388-4e21-4f8d-88fa-5d733c21b708+3:16976:x1876023308299392:12345-0@lo:104: Request processed in 43us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115640.185698:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789115640.185733:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789115640.185738:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d43f2 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185745:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521a00 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:2.0:1789115640.185748:0:16179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d43f2 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185755:0:16179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d43f2 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789115640.185763:0:16179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d43f2 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115640.185769:0:16179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789115640.185793:0:16179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d43f2 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185799:0:16179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789115640.185818:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d43f2 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185834:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcc1521a00/0xa47abda6516d43eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d43f2 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185848:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789115640.185851:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d42b7 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185856:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedac6400 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:2.0:1789115640.185858:0:16179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d42b7 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185865:0:16179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d42b7 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789115640.185870:0:16179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d42b7 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115640.185874:0:16179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789115640.185887:0:16179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d42b7 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185892:0:16179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789115640.185909:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d42b7 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185914:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcedac6400/0xa47abda6516d42b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d42b7 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185923:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789115640.185932:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa47abda6516d426a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185938:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcedacc000 already unused, calling callback (ffffffffc1d25c20) 10000000:00010000:2.0:1789115640.185940:0:16179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa47abda6516d426a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185947:0:16179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa47abda6516d426a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789115640.185953:0:16179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa47abda6516d426a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789115640.185958:0:16179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789115640.185970:0:16179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d426a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185975:0:16179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789115640.185981:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d426a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.185986:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff8dfcedacc000/0xa47abda6516d4263 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa47abda6516d426a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.186000:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115640.186002:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115640.186004:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115640.186010:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115640.186017:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789115640.186028:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91237388-4e21-4f8d-88fa-5d733c21b708:3307:1876023308299520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789115640.186059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115640.186100:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91237388-4e21-4f8d-88fa-5d733c21b708:3305:1876023308299648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789115640.186124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115640.186143:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789115640.186148:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91237388-4e21-4f8d-88fa-5d733c21b708:3305:1876023308299776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789115640.186170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115640.186195:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308299520 00000100:00100000:2.0:1789115640.186200:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308299520 00010000:00010000:2.0:1789115640.186217:0:14841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d43f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d43eb expref: 19 pid: 14848 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115640.186231:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308299648 00000100:00100000:2.0:1789115640.186233:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308299648 00010000:00010000:2.0:1789115640.186243:0:14841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcedacd800/0xa47abda6516d42b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d42b0 expref: 20 pid: 14849 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115640.186251:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308299776 00000100:00100000:2.0:1789115640.186253:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308299776 00010000:00010000:2.0:1789115640.186261:0:14841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfced9d3000/0xa47abda6516d426a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d4263 expref: 21 pid: 14846 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115640.186284:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789115640.186291:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91237388-4e21-4f8d-88fa-5d733c21b708+21:3307:x1876023308299520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789115640.186300:0:14841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115640.186305:0:14841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d43f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d43eb expref: 21 pid: 14848 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.186313:0:14841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d43f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d43eb expref: 21 pid: 14848 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.186327:0:14841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115640.186358:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91237388-4e21-4f8d-88fa-5d733c21b708+21:3307:x1876023308299520:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115640.186364:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789115640.186377:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789115640.186408:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91237388-4e21-4f8d-88fa-5d733c21b708+20:3305:x1876023308299648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789115640.186416:0:14841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115640.186419:0:14841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcedacd800/0xa47abda6516d42b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d42b0 expref: 20 pid: 14849 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.186426:0:14841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcedacd800/0xa47abda6516d42b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d42b0 expref: 20 pid: 14849 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.186435:0:14841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115640.186459:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91237388-4e21-4f8d-88fa-5d733c21b708+20:3305:x1876023308299648:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115640.186465:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789115640.186477:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789115640.186483:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf59850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91237388-4e21-4f8d-88fa-5d733c21b708+19:3305:x1876023308299776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789115640.186489:0:14841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115640.186493:0:14841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfced9d3000/0xa47abda6516d426a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa47abda6516d4263 expref: 19 pid: 14846 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.186500:0:14841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfced9d3000/0xa47abda6516d426a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa47abda6516d4263 expref: 19 pid: 14846 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.186509:0:14841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115640.186529:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf59850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91237388-4e21-4f8d-88fa-5d733c21b708+19:3305:x1876023308299776:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115640.186534:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789115640.186593:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91237388-4e21-4f8d-88fa-5d733c21b708:3307:1876023308299520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789115640.186613:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91237388-4e21-4f8d-88fa-5d733c21b708:3305:1876023308299776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789115640.186620:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91237388-4e21-4f8d-88fa-5d733c21b708:3305:1876023308299648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789115640.186808:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789115640.187781:0:16976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcedac7400/0xa47abda6516d43f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d43eb expref: 18 pid: 14848 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115640.187795:0:16976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf85e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16976:1876023308299136:0@lo:104: 00010000:00010000:3.0:1789115640.187806:0:16976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcedacd800/0xa47abda6516d42b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d42b0 expref: 17 pid: 14849 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115640.187813:0:16976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf86940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16976:1876023308299264:0@lo:104: 00010000:00010000:3.0:1789115640.187820:0:16976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfced9d3000/0xa47abda6516d426a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa47abda6516d4263 expref: 16 pid: 14846 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115640.187827:0:16976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf85680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16976:1876023308299392:0@lo:104: 00000100:00100000:0.0:1789115640.190026:0:16976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16976:1876023308298880:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115640.190041:0:16976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16976:1876023308299008:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115640.190078:0:16976:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115640.190199:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115640.191518:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115640.193374:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288383104 00000100:00100000:2.0:1789115640.193405:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288383104 00010000:00010000:2.0:1789115640.193443:0:14841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d4549 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f46 expref: 13 pid: 14848 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115640.193475:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288383232 00000100:00100000:2.0:1789115640.193479:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288383232 00010000:00010000:2.0:1789115640.193491:0:14841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d4511 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ee4 expref: 14 pid: 14846 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115640.193506:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1789115640.193514:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:008edc47-34ab-4767-b919-a366055c99eb+14:2352:x1876023288383104:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115640.193529:0:14841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115640.193534:0:14841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d4549 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f46 expref: 14 pid: 14848 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193545:0:14841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d4549 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f46 expref: 14 pid: 14848 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193562:0:14841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcc1520000/0xa47abda6516d4549 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f46 expref: 14 pid: 14848 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193577:0:14841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115640.193627:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:008edc47-34ab-4767-b919-a366055c99eb+13:2352:x1876023288383104:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 113us (3429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115640.193650:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1789115640.193667:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:2.0:1789115640.193673:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd217c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:008edc47-34ab-4767-b919-a366055c99eb+12:2353:x1876023288383232:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115640.193680:0:14841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115640.193684:0:14841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d4511 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ee4 expref: 12 pid: 14846 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193692:0:14841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d4511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ee4 expref: 12 pid: 14846 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193702:0:14841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfccf28f400/0xa47abda6516d4511 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ee4 expref: 12 pid: 14846 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193712:0:14841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193726:0:14841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193742:0:14841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193749:0:14841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193770:0:14841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193777:0:14841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193789:0:14841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eaa00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:2.0:1789115640.193792:0:14841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193800:0:14841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193812:0:14841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115640.193821:0:14841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115640.193841:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd217c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:008edc47-34ab-4767-b919-a366055c99eb+11:2353:x1876023288383232:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 169us (2330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115640.193848:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00010000:00010000:0.0:1789115640.194295:0:16976:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115640.194305:0:16976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115640.194317:0:16976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dfcff9eaa00/0xa47abda6516d4573 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115640.292206:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789115640.483889:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789115640.483918:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308299904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789115640.484002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115640.484320:0:15544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308299904 00000100:00100000:0.0:1789115640.484329:0:15544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308299904 00000100:00100000:0.0:1789115640.484420:0:15544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789115640.484431:0:15544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308299904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789115640.484470:0:15544:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789115640.484541:0:15544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308299904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115640.484550:0:15544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789115640.485138:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789115640.485200:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308299904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789115641.318104:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789115641.833175:0:14851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789115641.833188:0:14851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcc2c0f000 from 13 10000000:01000000:0.0:1789115641.833196:0:14851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789115641.835371:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3200/0xa47abda6516d457a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115641.835790:0:14851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3200/0xa47abda6516d457a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115641.835808:0:14851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3200/0xa47abda6516d457a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115641.837001:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd217e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789115641.837107:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115641.837166:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc724ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789115641.837363:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308300032 00000100:00100000:0.0:1789115641.837372:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308300032 00000100:00100000:0.0:1789115641.837450:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789115641.837461:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+16:14851:x1876023308300032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789115641.837497:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115641.837520:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfced9d3e00/0xa47abda6516d4581 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d457a expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115641.837549:0:14848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfced9d3e00/0xa47abda6516d4581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d457a expref: 17 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115641.837560:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfced9d3e00/0xa47abda6516d4581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d457a expref: 17 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115641.837571:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d3e00, rc 0) 00000100:00100000:0.0:1789115641.837660:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+17:14851:x1876023308300032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115641.837667:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789115641.843991:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd217e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115641.844031:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3200/0xa47abda6516d457a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4581 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115641.844046:0:14851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3200/0xa47abda6516d457a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d4581 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115641.844166:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115641.844255:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115641.846203:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc724ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789115641.848343:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308300160 00000100:00100000:3.0:1789115641.848362:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308300160 00000100:00100000:3.0:1789115641.848465:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789115641.848477:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc136ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+17:14851:x1876023308300160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115641.849523:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789115641.849594:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115641.850860:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc136ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+17:14851:x1876023308300160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2374us (6595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115641.850876:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789115641.866443:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115641.866513:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc724ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789115641.866554:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308300288 00000100:00100000:1.0:1789115641.866565:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308300288 00000100:00100000:1.0:1789115641.866626:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789115641.866637:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+17:14851:x1876023308300288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789115641.866909:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91237388-4e21-4f8d-88fa-5d733c21b708+17:14851:x1876023308300288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115641.866925:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789115641.866999:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789115641.867748:0:17048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789115641.867825:0:14851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789115641.867846:0:14851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789115641.867859:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3200/0xa47abda6516d457a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4581 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115641.867871:0:14851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfced9d3200/0xa47abda6516d457a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d4581 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789115641.867882:0:14851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789115641.867885:0:14851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcc81ea800 from 13 10000000:01000000:1.0:1789115641.867888:0:14851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789115641.867928:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfccf28e600/0xa47abda6516d4588 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115641.867935:0:14851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfccf28e600/0xa47abda6516d4588 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115641.867946:0:14851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfccf28e600/0xa47abda6516d4588 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115641.867972:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789115641.868027:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115641.868049:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc724c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789115641.868425:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308300416 00000100:00100000:3.0:1789115641.868433:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308300416 00000100:00100000:3.0:1789115641.868484:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789115641.868493:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+17:14851:x1876023308300416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115641.868510:0:14846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115641.868527:0:14846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcff9ea400/0xa47abda6516d458f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d4588 expref: -99 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115641.868559:0:14846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcff9ea400/0xa47abda6516d458f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d4588 expref: 18 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115641.868571:0:14846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcff9ea400/0xa47abda6516d458f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d4588 expref: 18 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115641.868580:0:14846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ea400, rc 0) 00000100:00100000:3.0:1789115641.868634:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+18:14851:x1876023308300416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115641.868642:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789115641.868694:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115641.868709:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfccf28e600/0xa47abda6516d4588 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d458f expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115641.868718:0:14851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfccf28e600/0xa47abda6516d4588 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d458f expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115641.868779:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf87c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115641.868807:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115641.868824:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd3dc5540 going to sleep for 11 seconds 00000100:00100000:3.0:1789115641.868851:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308300544 00000100:00100000:3.0:1789115641.868854:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308300544 00000100:00100000:3.0:1789115641.868873:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789115641.868879:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+18:14851:x1876023308300544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115641.869187:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+18:14851:x1876023308300544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115641.869193:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789115641.869225:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf87c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115641.869254:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf87c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115641.869303:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115641.869314:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc2efcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789115641.869447:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308300672 00000100:00100000:3.0:1789115641.869451:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308300672 00000100:00100000:3.0:1789115641.869467:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789115641.869473:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+18:14851:x1876023308300672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115641.869627:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+18:14851:x1876023308300672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115641.869634:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789115641.869671:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf87c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789115641.870334:0:17049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789115641.870429:0:14851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789115641.870445:0:14851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789115641.870456:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfccf28e600/0xa47abda6516d4588 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d458f expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115641.870467:0:14851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfccf28e600/0xa47abda6516d4588 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d458f expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789115641.870489:0:14851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789115641.870492:0:14851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dfcc5730000 from 13 10000000:01000000:3.0:1789115641.870494:0:14851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789115641.870526:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcff9ea800/0xa47abda6516d4596 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115641.870534:0:14851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff8dfcff9ea800/0xa47abda6516d4596 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115641.870544:0:14851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff8dfcff9ea800/0xa47abda6516d4596 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115641.870562:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf87c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789115641.870607:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115641.870627:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd37af840 going to sleep for 11 seconds 00000100:00100000:3.0:1789115641.870647:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308300800 00000100:00100000:3.0:1789115641.870652:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308300800 00000100:00100000:3.0:1789115641.870680:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789115641.870687:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+18:14851:x1876023308300800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115641.870699:0:14846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115641.870713:0:14846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfcff9eae00/0xa47abda6516d459d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa47abda6516d4596 expref: -99 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115641.870737:0:14846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfcff9eae00/0xa47abda6516d459d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa47abda6516d4596 expref: 19 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115641.870748:0:14846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfcff9eae00/0xa47abda6516d459d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa47abda6516d4596 expref: 19 pid: 14846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115641.870767:0:14846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eae00, rc 0) 00000100:00100000:3.0:1789115641.870802:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+19:14851:x1876023308300800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115641.870809:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789115641.870848:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf87c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789115641.870862:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff8dfcff9ea800/0xa47abda6516d4596 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d459d expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115641.870872:0:14851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff8dfcff9ea800/0xa47abda6516d4596 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa47abda6516d459d expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115641.870917:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf87c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115641.870942:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115641.870955:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd37af840 going to sleep for 11 seconds 00000100:00100000:3.0:1789115641.870966:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308300928 00000100:00100000:3.0:1789115641.870969:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308300928 00000100:00100000:3.0:1789115641.870985:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789115641.870991:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+19:14851:x1876023308300928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115641.871231:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+19:14851:x1876023308300928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115641.871238:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789115641.882548:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf87c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308300928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789115641.882634:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf87c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308301056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789115641.882738:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115641.882811:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd37af840 going to sleep for 11 seconds 00000100:00100000:0.0:1789115641.882888:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308301056 00000100:00100000:0.0:1789115641.882896:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308301056 00000100:00100000:0.0:1789115641.882963:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789115641.882973:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+19:14851:x1876023308301056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789115641.883217:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91237388-4e21-4f8d-88fa-5d733c21b708+19:14851:x1876023308301056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115641.883226:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789115641.883371:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf87c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91237388-4e21-4f8d-88fa-5d733c21b708:14851:1876023308301056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789115641.885835:0:17050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789115641.886028:0:14851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789115641.886051:0:14851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789115641.886092:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff8dfcff9ea800/0xa47abda6516d4596 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d459d expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115641.886107:0:14851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff8dfcff9ea800/0xa47abda6516d4596 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa47abda6516d459d expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115642.022923:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308301568:0@lo:400:kworker.0 00000100:00100000:2.0:1789115642.023022:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115642.023096:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789115642.023102:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308301184:0@lo:400:kworker.0 00000100:00100000:2.0:1789115642.023132:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115642.023156:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876023308301696:0@lo:400:kworker.0 00000100:00100000:2.0:1789115642.023179:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115642.023210:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308301312:0@lo:400:kworker.0 00000100:00100000:2.0:1789115642.023234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115642.023275:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789115642.023280:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcc603d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308301440:0@lo:400:kworker.0 00000100:00100000:2.0:1789115642.023319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115642.023353:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308301568 00000100:00100000:2.0:1789115642.023361:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308301568 00000100:00100000:2.0:1789115642.023451:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308301696 00000100:00100000:2.0:1789115642.023455:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308301696 00000100:00100000:2.0:1789115642.023469:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308301440 00000100:00100000:2.0:1789115642.023471:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308301440 00000100:00100000:2.0:1789115642.023487:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789115642.023497:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308301568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115642.023560:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876023308301568:12345-0@lo:400:kworker.0 Request processed in 63us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115642.023568:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789115642.023589:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789115642.023595:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876023308301696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115642.023620:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876023308301696:12345-0@lo:400:kworker.0 Request processed in 25us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115642.023626:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789115642.023636:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789115642.023641:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308301440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115642.023667:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876023308301440:12345-0@lo:400:kworker.0 Request processed in 26us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115642.023672:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789115642.023693:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308301184 00000100:00100000:2.0:1789115642.023696:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308301184 00000100:00100000:2.0:1789115642.023719:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308301312 00000100:00100000:2.0:1789115642.023722:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308301312 00000100:00100000:2.0:1789115642.023741:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789115642.023748:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308301184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115642.023785:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876023308301184:12345-0@lo:400:kworker.0 Request processed in 37us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115642.023791:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789115642.023802:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789115642.023807:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308301312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789115642.023830:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308301312:12345-0@lo:400:kworker.0 Request processed in 23us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115642.023836:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789115642.023851:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789115642.023855:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789115642.023859:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789115642.023893:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876023308301184:0@lo:400:kworker.0 00000100:00100000:2.0:1789115642.023904:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876023308301696:0@lo:400:kworker.0 00000100:00100000:2.0:1789115642.023913:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876023308301568:0@lo:400:kworker.0 00000100:00100000:2.0:1789115642.023947:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876023308301440:0@lo:400:kworker.0 00000100:00100000:2.0:1789115642.023957:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcc603fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308301312:0@lo:400:kworker.0 00000100:00100000:3.0:1789115642.024569:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308301824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789115642.024619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115642.027661:0:15544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308301824 00000100:00100000:2.0:1789115642.027681:0:15544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308301824 00000100:00100000:2.0:1789115642.027750:0:15544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789115642.027762:0:15544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308301824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789115642.027813:0:15544:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789115642.034612:0:15544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308301824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6838us (9978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115642.034633:0:15544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789115642.037624:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115642.037725:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288383360 00000100:00100000:1.0:1789115642.037738:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288383360 00000100:00100000:1.0:1789115642.037815:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:1.0:1789115642.037829:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+11:13977:x1876023288383360:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115642.037852:0:14849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115642.037876:0:14849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28f200/0xa47abda6516d45a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3f77 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115642.037915:0:14849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28f200/0xa47abda6516d45a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f77 expref: 12 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115642.037927:0:14849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28f200/0xa47abda6516d45a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f77 expref: 12 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115642.037939:0:14849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28f200, rc 0) 00000100:00100000:1.0:1789115642.038010:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+12:13977:x1876023288383360:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 184us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115642.038019:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:3.0:1789115642.040554:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308301824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789115642.048250:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115642.048356:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288383488 00000100:00100000:2.0:1789115642.048369:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288383488 00000100:00100000:2.0:1789115642.048461:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:2.0:1789115642.048474:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+12:13977:x1876023288383488:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115642.048833:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+12:13977:x1876023288383488:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 360us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115642.048843:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:0.0:1789115642.054821:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115642.054916:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288383616 00000100:00100000:2.0:1789115642.054930:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288383616 00000100:00100000:2.0:1789115642.055003:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:2.0:1789115642.055016:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+12:13977:x1876023288383616:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115642.055348:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+12:13977:x1876023288383616:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 332us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115642.055358:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:3.0:1789115642.071026:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115642.071112:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288383744 00000100:00100000:1.0:1789115642.071126:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288383744 00000100:00100000:1.0:1789115642.071202:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:1.0:1789115642.071214:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+12:13977:x1876023288383744:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789115642.071255:0:14849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115642.071292:0:14849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d45ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3f7e expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115642.071338:0:14849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d45ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f7e expref: 13 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115642.071352:0:14849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dfccf28fc00/0xa47abda6516d45ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f7e expref: 13 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115642.071364:0:14849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28fc00, rc 0) 00000100:00100000:1.0:1789115642.071484:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+13:13977:x1876023288383744:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 272us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115642.071493:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:0.0:1789115642.073642:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115642.073947:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288383872 00000100:00100000:2.0:1789115642.073958:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288383872 00000100:00100000:2.0:1789115642.074019:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:2.0:1789115642.074030:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+13:13977:x1876023288383872:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789115642.074446:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:008edc47-34ab-4767-b919-a366055c99eb+13:13977:x1876023288383872:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 417us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115642.074455:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:3.0:1789115642.084746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115642.084837:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288384000 00000100:00100000:2.0:1789115642.084850:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288384000 00000100:00100000:2.0:1789115642.084924:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:2.0:1789115642.084936:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+13:13977:x1876023288384000:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789115642.085233:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+13:13977:x1876023288384000:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 298us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115642.085243:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00010000:00010000:2.0:1789115642.339640:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115643.364274:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115643.365835:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115643.365884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115643.365925:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115643.365956:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115643.365975:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115643.365995:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115643.366014:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115643.366047:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288384640 00000100:00100000:2.0:1789115643.366059:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288384640 00000100:00100000:2.0:1789115643.366125:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288384256 00000100:00100000:2.0:1789115643.366127:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288384256 00000100:00100000:2.0:1789115643.366148:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1789115643.366159:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:2350:x1876023288384640:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115643.366217:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288384384 00000100:00100000:3.0:1789115643.366233:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288384384 00000100:00100000:2.0:1789115643.366271:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:2350:x1876023288384640:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 113us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115643.366360:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288384896 00000100:00100000:3.0:1789115643.366364:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288384896 00000100:00100000:3.0:1789115643.366430:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288384512 00000100:00100000:3.0:1789115643.366433:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288384512 00000100:00100000:3.0:1789115643.366450:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288384768 00000100:00100000:3.0:1789115643.366452:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288384768 00000100:00100000:2.0:1789115643.366462:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:3.0:1789115643.366470:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:3.0:1789115643.366479:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2350:x1876023288384384:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115643.366491:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:2.0:1789115643.366501:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:2350:x1876023288384256:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115643.366516:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2350:x1876023288384384:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 37us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115643.366525:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1789115643.366539:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:2350:x1876023288384256:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 38us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115643.366547:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1789115643.366551:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:3.0:1789115643.366558:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35b98319-ecbc-48a4-98d6-b960fe7c7d67+5:2350:x1876023288384896:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115643.366582:0:15540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1789115643.366609:0:15540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2350:x1876023288384512:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115643.366638:0:15540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2350:x1876023288384512:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 32us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115643.366645:0:15540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1789115643.366660:0:15540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1789115643.366666:0:15540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35b98319-ecbc-48a4-98d6-b960fe7c7d67+5:2350:x1876023288384768:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1789115643.366696:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35b98319-ecbc-48a4-98d6-b960fe7c7d67+5:2350:x1876023288384896:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 139us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115643.366698:0:15540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35b98319-ecbc-48a4-98d6-b960fe7c7d67+5:2350:x1876023288384768:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 30us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115643.366708:0:15540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00080000:2.0:1789115643.366723:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789115643.366727:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789115643.366730:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115643.366865:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:1.0:1789115643.367052:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288384128 00000100:00100000:1.0:1789115643.367058:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288384128 00000100:00100000:1.0:1789115643.367102:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:1.0:1789115643.367109:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+13:2350:x1876023288384128:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115643.367140:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:008edc47-34ab-4767-b919-a366055c99eb+13:2350:x1876023288384128:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 32us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115643.367146:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:2.0:1789115643.934953:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115643.939916:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288385024 00000100:00100000:0.0:1789115643.939937:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288385024 00000100:00100000:0.0:1789115643.940377:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1789115643.940629:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:14638:x1876023288385024:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115643.940679:0:14854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115643.940713:0:14854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d45b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3f85 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.940808:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.940827:0:14854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.940857:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.940872:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.940878:0:14854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.940883:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.942209:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3000/0xa47abda6516d45c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.942230:0:14854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3000/0xa47abda6516d45c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.942241:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3000/0xa47abda6516d45c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115643.942542:0:14854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789115643.942555:0:14854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115643.942667:0:14854:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3000/0xa47abda6516d45c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.942683:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.942691:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.942699:0:14854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.942706:0:14854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115643.942711:0:14854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.942719:0:14854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.942912:0:14854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:0.0:1789115643.942916:0:14854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115643.942923:0:14854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.942931:0:14854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.942946:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.942954:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.942971:0:14854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.943040:0:14854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115643.943044:0:14854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.943051:0:14854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.943060:0:14854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8dfcd045cb00) 00010000:00010000:0.0:1789115643.943063:0:14854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115643.943067:0:14854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.943073:0:14854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.943122:0:14854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d45b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f85 expref: 8 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.943139:0:14854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3000/0xa47abda6516d45c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f85 expref: 7 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115643.943635:0:14854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dfcd045cd00) 00010000:00010000:0.0:1789115643.943640:0:14854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789115643.943645:0:14854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d3000, rc 0) 00000100:00100000:0.0:1789115643.944668:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:14638:x1876023288385024:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 4035us (9722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115643.945611:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1789115643.958930:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115643.959831:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288385280 00000100:00100000:3.0:1789115643.959842:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288385280 00000100:00100000:3.0:1789115643.959908:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1789115643.959920:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:14638:x1876023288385280:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789115643.959942:0:14856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115643.959967:0:14856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d45ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3f8c expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.960038:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d45d5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.960052:0:14856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d45d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.960065:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d45d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.960081:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d45dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.960475:0:14856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d45dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.960484:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d45dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.964892:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d45e3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.964917:0:14856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d45e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.964943:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d45e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115643.964957:0:14856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1789115643.966805:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d45d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.966822:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d45d5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.966830:0:14856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d45d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.966836:0:14856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eaa00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115643.966841:0:14856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d45d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.966848:0:14856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d45d5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.966864:0:14856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dfcd045cd00) 00010000:00010000:3.0:1789115643.966867:0:14856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115643.966873:0:14856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d45d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.966878:0:14856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d45d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.966892:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d45dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.966898:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d45dc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.966912:0:14856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d45dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.966917:0:14856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115643.966920:0:14856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d45dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.966926:0:14856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d45dc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.966934:0:14856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8dfcf2156600) 00010000:00010000:3.0:1789115643.966937:0:14856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115643.966940:0:14856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d45dc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.966946:0:14856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d45dc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.969957:0:14856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d45ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f8c expref: 10 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.969981:0:14856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb200/0xa47abda6516d45e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f8c expref: 9 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115643.969989:0:14856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcf2156300) 00010000:00010000:3.0:1789115643.969992:0:14856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115643.969994:0:14856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb200, rc 0) 00000100:00100000:3.0:1789115643.970117:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+9:14638:x1876023288385280:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 10199us (11195us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789115643.970137:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:1.0:1789115643.980931:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115643.981611:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288385408 00000100:00100000:3.0:1789115643.981620:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288385408 00000100:00100000:3.0:1789115643.981709:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1789115643.981719:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+9:14638:x1876023288385408:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789115643.981834:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+9:14638:x1876023288385408:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 115us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115643.981841:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1789115644.026124:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115644.026215:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288385536 00000100:00100000:0.0:1789115644.026224:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288385536 00000100:00100000:0.0:1789115644.026292:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1789115644.026302:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+9:14644:x1876023288385536:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115644.026322:0:14855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115644.026351:0:14855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d45f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3f93 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026452:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026468:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026479:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026493:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026499:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026504:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026753:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026772:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026778:0:14855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026784:0:14855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115644.026788:0:14855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026795:0:14855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026808:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:0.0:1789115644.026811:0:14855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115644.026816:0:14855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026823:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d45f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026835:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026841:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026847:0:14855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026852:0:14855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115644.026861:0:14855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026868:0:14855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026877:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dfcd045cb00) 00010000:00010000:0.0:1789115644.026879:0:14855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115644.026882:0:14855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026888:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d45ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026921:0:14855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d45f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f93 expref: 10 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026932:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:0.0:1789115644.026934:0:14855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115644.026937:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d45f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f93 expref: 10 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.026945:0:14855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d2c00, rc 0) 00000100:00100000:0.0:1789115644.026999:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+9:14644:x1876023288385536:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 699us (885us total) trans 0 rc 301/301 00000100:00100000:0.0:1789115644.027007:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1789115644.034464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115644.034591:0:14863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288385664 00000100:00100000:3.0:1789115644.034601:0:14863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288385664 00000100:00100000:3.0:1789115644.034655:0:14863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1789115644.034666:0:14863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fed6308d-d83b-4b96-8e21-feae292eb9a7+9:14644:x1876023288385664:12345-192.168.203.31@tcp:700:lfs.0 00000100:00100000:3.0:1789115644.034757:0:14863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fed6308d-d83b-4b96-8e21-feae292eb9a7+9:14644:x1876023288385664:12345-192.168.203.31@tcp:700:lfs.0 Request processed in 92us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115644.034766:0:14863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:1.0:1789115644.041949:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115644.042045:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288385920 00000100:00100000:0.0:1789115644.042054:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288385920 00000100:00100000:0.0:1789115644.042112:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1789115644.042122:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+9:14644:x1876023288385920:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:0.0:1789115644.042191:0:14854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115644.042226:0:14854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e800/0xa47abda6516d4534 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f0e expref: 9 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.042257:0:14854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:0.0:1789115644.042262:0:14854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115644.042697:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.042712:0:14854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d456c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f70 expref: 5 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.042720:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.042750:0:14854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d456c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f70 expref: 5 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.042763:0:14854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d456c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f70 expref: 5 pid: 14855 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115644.042776:0:14854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd217e580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14854:1876023308301952:192.168.203.31@tcp:104: 00000100:00100000:1.0:1789115644.043079:0:14854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc805c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789115644.054235:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115644.054500:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288386048 00000100:00100000:2.0:1789115644.054510:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288386048 00010000:00010000:2.0:1789115644.054550:0:14841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d456c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f70 expref: 6 pid: 14855 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115644.054589:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1789115644.054598:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9103c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:2353:x1876023288386048:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115644.054612:0:14841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115644.054619:0:14841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d456c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f70 expref: 6 pid: 14855 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.054649:0:14841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d456c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f70 expref: 6 pid: 14855 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.054672:0:14841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:2.0:1789115644.054678:0:14841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.054687:0:14841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.054694:0:14841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.054710:0:14841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115644.054778:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9103c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:2353:x1876023288386048:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 181us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115644.054786:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00010000:00010000:1.0:1789115644.054939:0:14854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d456c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f70 expref: 5 pid: 14855 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115644.054965:0:14854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd217e580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14854:1876023308301952:192.168.203.31@tcp:104: 00010000:00010000:1.0:1789115644.054985:0:14854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.054993:0:14854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.054998:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.055018:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d460d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.055026:0:14854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d460d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.055033:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d460d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115644.058137:0:14854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1789115644.058175:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.058187:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.058195:0:14854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.058202:0:14854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115644.058215:0:14854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.058223:0:14854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.058241:0:14854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd01aeb00) 00010000:00010000:1.0:1789115644.058255:0:14854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115644.058261:0:14854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.058267:0:14854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2c00/0xa47abda6516d4606 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789115644.058289:0:14854:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000f53f73e reply state 00000000f953c026 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d460d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115644.058298:0:14854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789115644.061105:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+10:14644:x1876023288385920:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 18971us (19152us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789115644.061118:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00010000:00010000:1.0:1789115644.066452:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d460d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.066469:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d460d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.066477:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d460d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.066483:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28e000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115644.066487:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d460d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.066505:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d460d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.066521:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dfcd01ae200) 00010000:00010000:1.0:1789115644.066524:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115644.066528:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d460d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.066534:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28e000/0xa47abda6516d460d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115644.140867:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115644.140962:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288386176 00000100:00100000:0.0:1789115644.140973:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288386176 00000100:00100000:0.0:1789115644.141034:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1789115644.141044:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+9:14652:x1876023288386176:12345-192.168.203.31@tcp:101:lctl.0 00010000:00010000:0.0:1789115644.141082:0:14855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115644.141105:0:14855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d4614 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3f9a expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.141173:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d461b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.141187:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d461b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.141198:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d461b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115644.141267:0:14855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789115644.141271:0:14855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115644.141311:0:14855:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d461b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.141332:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d4614 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f9a expref: 11 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.141349:0:14855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2800/0xa47abda6516d461b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3f9a expref: 10 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.141357:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd045cb00) 00010000:00010000:0.0:1789115644.141360:0:14855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789115644.141363:0:14855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d2800, rc 0) 00000100:00100000:0.0:1789115644.141467:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+10:14652:x1876023288386176:12345-192.168.203.31@tcp:101:lctl.0 Request processed in 425us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115644.141474:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1789115644.173360:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115644.173491:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288386304 00000100:00100000:3.0:1789115644.173501:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288386304 00000100:00100000:3.0:1789115644.173562:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1789115644.173572:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc603c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35b98319-ecbc-48a4-98d6-b960fe7c7d67+5:14653:x1876023288386304:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789115644.173592:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115644.173613:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4622 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3fa1 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.173677:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d4629 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.173705:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d4629 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.173716:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d4629 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115644.173785:0:16274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789115644.173789:0:16274:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1789115644.173816:0:16274:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d4629 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.173841:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4622 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fa1 expref: 7 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.173858:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eaa00/0xa47abda6516d4629 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fa1 expref: 6 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.173866:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd045cb00) 00010000:00010000:3.0:1789115644.173870:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789115644.173873:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eaa00, rc 0) 00000100:00100000:3.0:1789115644.173943:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc603c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:14653:x1876023288386304:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 372us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115644.173951:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1789115644.179777:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115644.179855:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288386432 00000100:00100000:0.0:1789115644.179865:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288386432 00000100:00100000:0.0:1789115644.179932:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1789115644.179942:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:14653:x1876023288386432:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1789115644.179970:0:14855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115644.179992:0:14855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d4630 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3fa8 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180055:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4637 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180070:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4637 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180080:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4637 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180110:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d463e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180118:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d463e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180124:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d463e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180268:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d4645 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180277:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d4645 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180299:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d4645 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789115644.180339:0:14855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789115644.180342:0:14855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789115644.180367:0:14855:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d4645 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180424:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4637 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180431:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4637 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180437:0:14855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4637 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180443:0:14855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115644.180446:0:14855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4637 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180454:0:14855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4637 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180464:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd045cb00) 00010000:00010000:0.0:1789115644.180467:0:14855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115644.180471:0:14855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4637 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180477:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d4637 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180503:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d463e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180507:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d463e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180512:0:14855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d463e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180517:0:14855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115644.180519:0:14855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d463e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180525:0:14855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d463e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180532:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dfcd045c300) 00010000:00010000:0.0:1789115644.180534:0:14855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115644.180537:0:14855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d463e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180542:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3c00/0xa47abda6516d463e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180572:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d4630 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fa8 expref: 8 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180586:0:14855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d4645 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fa8 expref: 7 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.180604:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dfcd045c800) 00010000:00010000:0.0:1789115644.180607:0:14855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789115644.180609:0:14855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d2a00, rc 0) 00000100:00100000:0.0:1789115644.180680:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+7:14653:x1876023288386432:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 739us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115644.180688:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1789115644.185210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115644.191140:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288386688 00000100:00100000:3.0:1789115644.191155:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288386688 00000100:00100000:3.0:1789115644.191234:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1789115644.191257:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff911a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35b98319-ecbc-48a4-98d6-b960fe7c7d67+7:14653:x1876023288386688:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789115644.191278:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115644.191315:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d464c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3faf expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115644.191463:0:16274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789115644.191593:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d464c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3faf expref: 9 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.191606:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd045cb00) 00010000:00010000:3.0:1789115644.191609:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789115644.191614:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d464c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3faf expref: 9 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.191628:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb000, rc 0) 00000100:00100000:3.0:1789115644.191694:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff911a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35b98319-ecbc-48a4-98d6-b960fe7c7d67+8:14653:x1876023288386688:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 451us (6498us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1789115644.191702:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1789115644.198702:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115644.199008:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288386944 00000100:00100000:0.0:1789115644.199018:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288386944 00000100:00100000:0.0:1789115644.199077:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1789115644.199087:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfceda9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+8:14653:x1876023288386944:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:0.0:1789115644.199138:0:14855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115644.199162:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2a00/0xa47abda6516d4645 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fa8 expref: 8 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.199181:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dfcd045c800) 00010000:00010000:0.0:1789115644.199190:0:14855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789115644.199211:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d465a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.199223:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d465a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115644.199232:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d465a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789115644.199519:0:14855:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a1520de8 reply state 00000000fbaacc0b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d465a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115644.199542:0:14855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789115644.199556:0:14855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1789115644.199647:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfceda9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+9:14653:x1876023288386944:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 561us (954us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789115644.199654:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00010000:00010000:1.0:1789115644.201127:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d465a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.201142:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d465a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.201149:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d465a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.201155:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115644.201160:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d465a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.201168:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d465a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.201184:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dfcd045c300) 00010000:00010000:1.0:1789115644.201187:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789115644.201202:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d465a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.201208:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d2000/0xa47abda6516d465a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115644.201912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115644.201980:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288387200 00000100:00100000:1.0:1789115644.201989:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288387200 00000100:00100000:1.0:1789115644.202043:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1789115644.202052:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35b98319-ecbc-48a4-98d6-b960fe7c7d67+8:14653:x1876023288387200:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1789115644.202327:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35b98319-ecbc-48a4-98d6-b960fe7c7d67+9:14653:x1876023288387200:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 266us (412us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789115644.202335:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:2.0:1789115644.204884:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115644.204990:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288387456 00000100:00100000:3.0:1789115644.204999:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288387456 00000100:00100000:3.0:1789115644.205053:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:3.0:1789115644.205063:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc25703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35b98319-ecbc-48a4-98d6-b960fe7c7d67+9:14653:x1876023288387456:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789115644.205088:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115644.205111:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3fb6 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205183:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4668 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205198:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4668 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205222:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4668 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205237:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d466f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205255:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d466f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205262:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d466f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115644.205420:0:16274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789115644.205510:0:16274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4668 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205519:0:16274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4668 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205526:0:16274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4668 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205532:0:16274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115644.205537:0:16274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4668 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205544:0:16274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4668 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205556:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd045cb00) 00010000:00010000:3.0:1789115644.205559:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115644.205570:0:16274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4668 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205577:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4668 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205589:0:16274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d466f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205595:0:16274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d466f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205601:0:16274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d466f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205607:0:16274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ebe00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115644.205610:0:16274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d466f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205615:0:16274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d466f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205624:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dfcf2156600) 00010000:00010000:3.0:1789115644.205626:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115644.205629:0:16274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d466f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205635:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d466f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205673:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4661 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fb6 expref: 11 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205694:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd045cb00) 00010000:00010000:3.0:1789115644.205697:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789115644.205702:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fb6 expref: 11 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.205712:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb000, rc 0) 00000100:00100000:3.0:1789115644.205775:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc25703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35b98319-ecbc-48a4-98d6-b960fe7c7d67+10:14653:x1876023288387456:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 713us (901us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789115644.205783:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1789115644.211189:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115644.211308:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288387584 00000100:00100000:2.0:1789115644.211325:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288387584 00000100:00100000:2.0:1789115644.211424:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:2.0:1789115644.211433:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff910780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+10:14653:x1876023288387584:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1789115644.211460:0:14855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115644.211485:0:14855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d467d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3fbd expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.211585:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4684 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.211598:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4684 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.211609:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4684 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115644.211656:0:14855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789115644.211660:0:14855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789115644.211679:0:14855:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4684 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.211704:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d467d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fbd expref: 12 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.211719:0:14855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4684 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fbd expref: 11 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.211737:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dfcc3201a00) 00010000:00010000:2.0:1789115644.211739:0:14855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789115644.211742:0:14855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1521a00, rc 0) 00000100:00100000:2.0:1789115644.211798:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff910780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+11:14653:x1876023288387584:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 367us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115644.211805:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:2.0:1789115644.215285:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115644.215404:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288387712 00000100:00100000:1.0:1789115644.215413:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288387712 00000100:00100000:1.0:1789115644.215470:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:1.0:1789115644.215480:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2570f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35b98319-ecbc-48a4-98d6-b960fe7c7d67+11:14653:x1876023288387712:12345-192.168.203.31@tcp:37:lfs.0 00000100:00100000:2.0:1789115644.223528:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2570f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35b98319-ecbc-48a4-98d6-b960fe7c7d67+11:14653:x1876023288387712:12345-192.168.203.31@tcp:37:lfs.0 Request processed in 8038us (8241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115644.223553:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1789115644.229148:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115644.229291:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288387968 00000100:00100000:3.0:1789115644.229299:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288387968 00000100:00100000:3.0:1789115644.229350:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1789115644.229359:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc2d8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+11:14653:x1876023288387968:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1789115644.229695:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc2d8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+12:14653:x1876023288387968:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 336us (554us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789115644.229703:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:0.0:1789115644.296967:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115644.297063:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288388096 00000100:00100000:3.0:1789115644.297074:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288388096 00000100:00100000:3.0:1789115644.297141:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:3.0:1789115644.297152:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff913c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+10:14659:x1876023288388096:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1789115644.297171:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115644.297192:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d468b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3fc4 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297266:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4692 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297292:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297303:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297318:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4699 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297325:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297332:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297487:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d46a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297496:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d46a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297504:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d46a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115644.297537:0:16274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1789115644.297541:0:16274:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789115644.297585:0:16274:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d46a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297597:0:16274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297614:0:16274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4692 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297621:0:16274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4692 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297627:0:16274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ebe00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115644.297631:0:16274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4692 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297638:0:16274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4692 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297651:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd045cb00) 00010000:00010000:3.0:1789115644.297655:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115644.297659:0:16274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4692 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297666:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4692 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297680:0:16274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297685:0:16274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4699 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297691:0:16274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4699 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297696:0:16274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115644.297705:0:16274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4699 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297711:0:16274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4699 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297718:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dfcf2156600) 00010000:00010000:3.0:1789115644.297721:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115644.297723:0:16274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4699 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297729:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d4699 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297900:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d468b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fc4 expref: 12 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297916:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb400/0xa47abda6516d46a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fc4 expref: 11 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.297923:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dfcc3201a00) 00010000:00010000:3.0:1789115644.297925:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789115644.297928:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb400, rc 0) 00000100:00100000:3.0:1789115644.299207:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff913c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+11:14659:x1876023288388096:12345-192.168.203.31@tcp:101:bash.0 Request processed in 2048us (2240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115644.299218:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:1.0:1789115644.305916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115644.306082:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288388352 00000100:00100000:2.0:1789115644.306092:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288388352 00000100:00100000:2.0:1789115644.306149:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:2.0:1789115644.306159:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+11:14659:x1876023288388352:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1789115644.306180:0:14855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115644.306203:0:14855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d46a7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3fcb expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.306340:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.306355:0:14855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4684 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fbd expref: 11 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.306364:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.306438:0:14855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4684 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fbd expref: 11 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.306450:0:14855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4684 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fbd expref: 11 pid: 14855 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115644.306464:0:14855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2570000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14855:1876023308302080:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115644.306558:0:14855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789115644.314719:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115644.314799:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288388480 00000100:00100000:3.0:1789115644.314808:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288388480 00010000:00010000:3.0:1789115644.314855:0:14839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4684 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fbd expref: 12 pid: 14855 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115644.314889:0:14855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2570000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14855:1876023308302080:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115644.314924:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00010000:00010000:2.0:1789115644.314924:0:14855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115644.314938:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9121c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35b98319-ecbc-48a4-98d6-b960fe7c7d67+12:2352:x1876023288388480:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789115644.314969:0:14839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115644.314978:0:14839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4684 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fbd expref: 12 pid: 14855 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.314992:0:14839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4684 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fbd expref: 12 pid: 14855 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.315015:0:14839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4684 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fbd expref: 12 pid: 14855 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.315031:0:14839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dfcc3201a00) 00010000:00010000:3.0:1789115644.315036:0:14839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.315046:0:14839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.315053:0:14839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.315082:0:14839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789115644.315139:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9121c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35b98319-ecbc-48a4-98d6-b960fe7c7d67+11:2352:x1876023288388480:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 205us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115644.315147:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00010000:00010000:2.0:1789115644.315570:0:14855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.315580:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.315605:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d46b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.315615:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d46b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.315624:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d46b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.317365:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d46bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.317448:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d46bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.317462:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d46bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115644.317475:0:14855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789115644.317505:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.317512:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.317530:0:14855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.317536:0:14855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1520000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115644.317541:0:14855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.317548:0:14855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.317561:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dfcc3201a00) 00010000:00010000:2.0:1789115644.317565:0:14855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115644.317570:0:14855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.317577:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46ae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789115644.317590:0:14855:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a055569c reply state 00000000b74aab17 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d46b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115644.317598:0:14855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789115644.317633:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d46a7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fcb expref: 14 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.317647:0:14855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d46bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fcb expref: 13 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.317654:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:2.0:1789115644.317661:0:14855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789115644.317664:0:14855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1520600, rc 0) 00000100:00100000:2.0:1789115644.317823:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+14:14659:x1876023288388352:12345-192.168.203.31@tcp:101:bash.0 Request processed in 11664us (11915us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789115644.317832:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00010000:00010000:1.0:1789115644.319925:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d46b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.319943:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d46b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.319961:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d46b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.319969:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115644.319973:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d46b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.319994:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d46b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.320009:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8dfcc3201100) 00010000:00010000:1.0:1789115644.320012:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115644.320017:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d46b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.320023:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d46b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115644.331194:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115644.331539:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288388608 00000100:00100000:1.0:1789115644.331547:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288388608 00000100:00100000:1.0:1789115644.331611:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:1.0:1789115644.331622:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+13:14659:x1876023288388608:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1789115644.331648:0:14854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115644.331670:0:14854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d46ca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3fd2 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.331737:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28fa00/0xa47abda6516d46d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.331763:0:14854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28fa00/0xa47abda6516d46d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.331775:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28fa00/0xa47abda6516d46d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115644.331811:0:14854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789115644.331829:0:14854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115644.331855:0:14854:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28fa00/0xa47abda6516d46d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.331866:0:14854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28fa00/0xa47abda6516d46d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.331891:0:14854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ea00/0xa47abda6516d46ca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fd2 expref: 15 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.331910:0:14854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28fa00/0xa47abda6516d46d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fd2 expref: 14 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115644.331918:0:14854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:1.0:1789115644.331921:0:14854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789115644.331925:0:14854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28fa00, rc 0) 00000100:00100000:1.0:1789115644.332178:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+14:14659:x1876023288388608:12345-192.168.203.31@tcp:101:bash.0 Request processed in 556us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115644.332185:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1789115644.343240:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115644.343361:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288388864 00000100:00100000:2.0:1789115644.343371:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288388864 00000100:00100000:2.0:1789115644.343452:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:2.0:1789115644.343463:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff910b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+14:14659:x1876023288388864:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:2.0:1789115644.343775:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff910b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+15:14659:x1876023288388864:12345-192.168.203.31@tcp:35:bash.0 Request processed in 314us (545us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789115644.343784:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00010000:00010000:2.0:1789115644.388073:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115644.449326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115644.449622:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288389120 00000100:00100000:3.0:1789115644.449645:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288389120 00000100:00100000:3.0:1789115644.449703:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1789115644.449723:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfbc2570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+15:14669:x1876023288389120:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789115644.449748:0:14856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115644.449769:0:14856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d46d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3fd9 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115644.449884:0:14856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789115644.450236:0:14856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d46d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fd9 expref: 17 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.450261:0:14856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfcd045cb00) 00010000:00010000:3.0:1789115644.450264:0:14856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789115644.450270:0:14856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d46d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fd9 expref: 17 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.450285:0:14856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb000, rc 0) 00000100:00100000:3.0:1789115644.450362:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfbc2570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+16:14669:x1876023288389120:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 650us (1055us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789115644.450369:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1789115644.454627:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115644.454718:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288389376 00000100:00100000:3.0:1789115644.454738:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288389376 00000100:00100000:3.0:1789115644.454798:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1789115644.454809:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff910f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+16:14669:x1876023288389376:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1789115644.455084:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff910f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+17:14669:x1876023288389376:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 276us (465us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789115644.455093:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1789115644.571029:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115644.571166:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288389632 00000100:00100000:3.0:1789115644.571176:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288389632 00000100:00100000:3.0:1789115644.571252:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:3.0:1789115644.571262:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff912d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+17:14672:x1876023288389632:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1789115644.571287:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115644.571318:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d46e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3fe0 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.571452:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d46ed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.571467:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d46ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.571478:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d46ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115644.571490:0:16274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789115644.571610:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d46e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fe0 expref: 20 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.571630:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d46ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fe0 expref: 19 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115644.571639:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:3.0:1789115644.571642:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789115644.571646:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ea000, rc 0) 00000100:00100000:3.0:1789115644.571709:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff912d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+19:14672:x1876023288389632:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 448us (691us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789115644.571731:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:0.0:1789115644.575737:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115644.575946:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288389760 00000100:00100000:2.0:1789115644.575966:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288389760 00000100:00100000:2.0:1789115644.576019:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:2.0:1789115644.576029:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+19:14672:x1876023288389760:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1789115644.576095:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.576111:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.576123:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.576150:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.576181:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.576188:0:14855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.576194:0:14855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1520000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115644.576198:0:14855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.576207:0:14855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.576219:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:2.0:1789115644.576222:0:14855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789115644.576227:0:14855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46fb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.576233:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d46fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115644.576323:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+19:14672:x1876023288389760:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 294us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115644.576331:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:0.0:1789115644.578933:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115644.579238:0:14840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288389888 00000100:00100000:2.0:1789115644.579263:0:14840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288389888 00000100:00100000:2.0:1789115644.579325:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1789115644.579333:0:14841:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789115644.579337:0:14840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff911e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+19:2352:x1876023288389888:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789115644.579345:0:14841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1789115644.579354:0:14840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115644.579408:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d46ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fe0 expref: 19 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115644.579425:0:14840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:2.0:1789115644.579430:0:14840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115644.579492:0:14840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff911e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+18:2352:x1876023288389888:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 158us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115644.579502:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1789115644.587275:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115644.593149:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288390144 00000100:00100000:3.0:1789115644.593163:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288390144 00000100:00100000:3.0:1789115644.593236:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1789115644.593257:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+18:14672:x1876023288390144:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1789115644.593520:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+19:14672:x1876023288390144:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 264us (6455us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789115644.593528:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000040:00080000:2.0:1789115644.836029:0:14889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789115645.007180:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115645.007357:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288390400 00000100:00100000:3.0:1789115645.007367:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288390400 00000100:00100000:3.0:1789115645.007487:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:3.0:1789115645.007498:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+19:14703:x1876023288390400:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:3.0:1789115645.007522:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115645.007546:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4702 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3fe7 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.007663:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4709 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.007676:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4709 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.007688:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4709 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115645.007698:0:16274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789115645.007871:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4702 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fe7 expref: 22 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.007889:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4709 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fe7 expref: 21 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.007898:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:3.0:1789115645.007901:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789115645.007904:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ebe00, rc 0) 00000100:00100000:3.0:1789115645.007962:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+21:14703:x1876023288390400:12345-192.168.203.31@tcp:101:cat.0 Request processed in 466us (803us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1789115645.007970:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00080000:2.0:1789115645.010910:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789115645.013546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115645.013769:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288390656 00000100:00100000:2.0:1789115645.013782:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288390656 00000100:00100000:2.0:1789115645.013864:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:2.0:1789115645.013877:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff912940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+21:14703:x1876023288390656:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:2.0:1789115645.014668:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff912940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+22:14703:x1876023288390656:12345-192.168.203.31@tcp:35:cat.0 Request processed in 786us (1131us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789115645.014681:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1789115645.015678:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115645.016416:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288390784 00000100:00100000:2.0:1789115645.016431:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288390784 00000100:00100000:2.0:1789115645.016524:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:2.0:1789115645.016537:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+22:2352:x1876023288390784:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115645.016556:0:14839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115645.016597:0:14839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d4709 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fe7 expref: 22 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.016628:0:14839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:2.0:1789115645.016635:0:14839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115645.017352:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+21:2352:x1876023288390784:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 813us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115645.017363:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:3.0:1789115645.111214:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115645.113531:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288391040 00000100:00100000:2.0:1789115645.113553:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288391040 00000100:00100000:2.0:1789115645.113719:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1789115645.113734:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+21:14709:x1876023288391040:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1789115645.113769:0:14855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115645.113799:0:14855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d4717 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3fee expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.113955:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d471e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.113972:0:14855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d46bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fcb expref: 22 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.113983:0:14855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28fa00/0xa47abda6516d46d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fd2 expref: 22 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.113993:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d471e lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.114037:0:14855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28fa00/0xa47abda6516d46d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fd2 expref: 22 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.114053:0:14855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28fa00/0xa47abda6516d46d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fd2 expref: 22 pid: 14854 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115645.114106:0:14855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfbc2570f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14855:1876023308302208:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789115645.114283:0:14855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d46bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fcb expref: 22 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.114293:0:14855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d46bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fcb expref: 22 pid: 14855 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115645.114304:0:14855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09a940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14855:1876023308302336:192.168.203.31@tcp:104: 00000100:00100000:2.0:1789115645.114331:0:14855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789115645.117691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115645.117733:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115645.117867:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288391168 00000100:00100000:1.0:1789115645.117879:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288391168 00010000:00010000:1.0:1789115645.117925:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28fa00/0xa47abda6516d46d1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fd2 expref: 23 pid: 14854 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115645.117968:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288391296 00000100:00100000:1.0:1789115645.117971:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288391296 00010000:00010000:1.0:1789115645.117980:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d46bc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fcb expref: 24 pid: 14855 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115645.118020:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1789115645.118028:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcffad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+24:2352:x1876023288391168:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115645.118047:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115645.118055:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28fa00/0xa47abda6516d46d1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fd2 expref: 24 pid: 14854 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.118068:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28fa00/0xa47abda6516d46d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fd2 expref: 24 pid: 14854 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.118112:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:1.0:1789115645.118118:0:17090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d471e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.118132:0:17090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d471e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.118139:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115645.118199:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcffad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+24:2352:x1876023288391168:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 170us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115645.118208:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1789115645.118422:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1789115645.118432:0:14840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff910000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+23:2353:x1876023288391296:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789115645.118441:0:14840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115645.118447:0:14840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d46bc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fcb expref: 23 pid: 14855 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115645.118461:0:14840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d46bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fcb expref: 23 pid: 14855 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115645.118480:0:14840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:0.0:1789115645.118483:0:14840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d471e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115645.118492:0:14840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d471e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115645.118500:0:14840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d471e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115645.118517:0:14840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115645.118538:0:14840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff910000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+23:2353:x1876023288391296:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 108us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115645.118549:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00010000:00010000:2.0:1789115645.120252:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28fa00/0xa47abda6516d46d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fd2 expref: 22 pid: 14854 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115645.120347:0:14855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfbc2570f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14855:1876023308302208:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789115645.120900:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d46bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fcb expref: 21 pid: 14855 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115645.120916:0:14855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09a940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14855:1876023308302336:192.168.203.31@tcp:104: 00010000:00010000:2.0:1789115645.120968:0:14855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d471e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.120979:0:14855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d471e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.120984:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d471e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115645.121032:0:14855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789115645.121304:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d4717 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fee expref: 22 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.121322:0:14855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521e00/0xa47abda6516d471e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3fee expref: 21 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.121333:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:2.0:1789115645.121336:0:14855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789115645.121340:0:14855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1521e00, rc 0) 00000100:00100000:2.0:1789115645.121435:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+21:14709:x1876023288391040:12345-192.168.203.31@tcp:101:dd.0 Request processed in 7704us (10236us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789115645.121447:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1789115645.131363:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115645.131672:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288391552 00000100:00100000:3.0:1789115645.131686:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288391552 00000100:00100000:3.0:1789115645.131775:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:3.0:1789115645.131787:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+21:14709:x1876023288391552:12345-192.168.203.31@tcp:36:dd.0 00010000:00010000:3.0:1789115645.135147:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d472c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.135181:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d472c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.135195:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d472c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789115645.135628:0:16274:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789115645.135700:0:16274:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f4de5105 reply state 00000000874e1f5f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d472c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115645.135738:0:16274:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789115645.137498:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+24:14709:x1876023288391552:12345-192.168.203.31@tcp:36:dd.0 Request processed in 5696us (6133us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789115645.137513:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000020:00080000:3.0:1789115645.137522:0:16274:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789115645.150226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115645.151070:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288391680 00000100:00100000:3.0:1789115645.151087:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288391680 00000100:00100000:3.0:1789115645.151189:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:3.0:1789115645.151201:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff912580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+24:14709:x1876023288391680:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789115645.151248:0:14856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115645.151288:0:14856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d4733 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3ff5 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.151372:0:14856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d4733 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ff5 expref: 25 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.151428:0:14856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d4733 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ff5 expref: 25 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.151453:0:14856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:3.0:1789115645.151457:0:14856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789115645.151462:0:14856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ebc00, rc 0) 00000100:00100000:3.0:1789115645.151540:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff912580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+25:14709:x1876023288391680:12345-192.168.203.31@tcp:101:dd.0 Request processed in 341us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115645.151548:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00010000:00010000:1.0:1789115645.154524:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d472c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.154549:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d472c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.154587:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d472c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.154595:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115645.154601:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d472c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.154610:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d472c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.154642:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:1.0:1789115645.154646:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789115645.154657:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d472c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.154664:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d472c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115645.199859:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115645.200148:0:14840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288391936 00000100:00100000:0.0:1789115645.200161:0:14840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288391936 00000100:00100000:0.0:1789115645.200259:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1789115645.200484:0:14840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf87840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+24:14709:x1876023288391936:12345-192.168.203.31@tcp:103:dd.0 00010000:00010000:0.0:1789115645.200505:0:14840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789115645.200537:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebc00/0xa47abda6516d4733 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ff5 expref: 24 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115645.200563:0:14840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:0.0:1789115645.200569:0:14840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789115645.200859:0:14840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf87840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+23:14709:x1876023288391936:12345-192.168.203.31@tcp:103:dd.0 Request processed in 380us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115645.200883:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1789115645.213034:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115645.213222:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288392064 00000100:00100000:2.0:1789115645.213236:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288392064 00000100:00100000:2.0:1789115645.213573:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:2.0:1789115645.213693:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+23:14709:x1876023288392064:12345-192.168.203.31@tcp:58:dd.0 00010000:00010000:2.0:1789115645.214424:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d473a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.214449:0:14854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d473a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.214463:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d473a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789115645.220080:0:14854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789115645.221155:0:14854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789115645.223208:0:14854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789115645.224928:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+23:14709:x1876023288392064:12345-192.168.203.31@tcp:58:dd.0 Request processed in 11328us (11894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115645.224945:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:1.0:1789115645.233040:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115645.233166:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288392192 00000100:00100000:3.0:1789115645.233179:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288392192 00000100:00100000:3.0:1789115645.233280:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1789115645.233292:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+23:14709:x1876023288392192:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1789115645.233320:0:14856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115645.233345:0:14856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d4741 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa3ffc expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.233469:0:14856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d473a lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.233482:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d4741 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ffc expref: 24 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.233507:0:14856:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d473a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.233522:0:14856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d4741 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ffc expref: 24 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.233538:0:14856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:3.0:1789115645.233541:0:14856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789115645.233546:0:14856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d4741 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ffc expref: 24 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.233555:0:14856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9eb800, rc 0) 00000100:00100000:3.0:1789115645.233646:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+24:14709:x1876023288392192:12345-192.168.203.31@tcp:101:dd.0 Request processed in 356us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115645.233654:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00010000:00010000:2.0:1789115645.412339:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789115645.608255:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308302464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789115645.608366:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115645.608731:0:15544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308302464 00000100:00100000:3.0:1789115645.608742:0:15544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308302464 00000100:00080000:2.0:1789115645.608886:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789115645.609344:0:15544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789115645.609359:0:15544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308302464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789115645.609441:0:15544:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789115645.609527:0:15544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308302464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115645.610269:0:15544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789115645.610438:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308302464:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789115645.859790:0:14889:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789115645.859808:0:14889:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789115645.859867:0:14889:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789115645.859875:0:14889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789115645.861122:0:14889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14889:1876023308302592:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789115645.861276:0:14889:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd1233240 going to sleep for 11 seconds 00000100:00100000:1.0:1789115645.870806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115645.870959:0:14889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14889:1876023308302592:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789115645.871795:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288392320 00000100:00100000:3.0:1789115645.871809:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288392320 00000100:00100000:3.0:1789115645.871878:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1789115645.871888:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fed6308d-d83b-4b96-8e21-feae292eb9a7+24:14710:x1876023288392320:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789115645.871996:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fed6308d-d83b-4b96-8e21-feae292eb9a7+24:14710:x1876023288392320:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 Request processed in 109us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115645.872005:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1789115645.878736:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115645.879155:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288392448 00000100:00100000:2.0:1789115645.879169:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288392448 00000100:00100000:2.0:1789115645.879263:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:2.0:1789115645.879276:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+24:14710:x1876023288392448:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789115645.879319:0:16274:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789115645.879509:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+24:14710:x1876023288392448:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 234us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115645.879519:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:0.0:1789115645.892379:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115645.892803:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288392576 00000100:00100000:3.0:1789115645.892816:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288392576 00000100:00100000:3.0:1789115645.893021:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:3.0:1789115645.893036:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff913840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+24:14710:x1876023288392576:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789115645.893144:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d4748 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.893166:0:14856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d4748 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.893185:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d4748 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.894749:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d474f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.894776:0:14856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d474f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.894790:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d474f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.894824:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4756 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.894834:0:14856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.894841:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789115645.894889:0:14856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789115645.894894:0:14856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789115645.894909:0:14856:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.894922:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d4748 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.894929:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d4748 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.894935:0:14856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d4748 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.894960:0:14856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115645.894965:0:14856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d4748 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.894973:0:14856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d4748 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.894985:0:14856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcf2156300) 00010000:00010000:3.0:1789115645.894988:0:14856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115645.894993:0:14856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d4748 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.894999:0:14856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d4748 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.895016:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d474f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.895022:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d474f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.895027:0:14856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d474f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.895033:0:14856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eba00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115645.895036:0:14856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d474f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.895042:0:14856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d474f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.895061:0:14856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8dfcf2156600) 00010000:00010000:3.0:1789115645.895063:0:14856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115645.895067:0:14856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d474f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.895073:0:14856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d474f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.895089:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.895095:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4756 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.895100:0:14856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4756 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.895104:0:14856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115645.895107:0:14856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4756 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.895113:0:14856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4756 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.895120:0:14856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:3.0:1789115645.895122:0:14856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115645.895125:0:14856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4756 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.895131:0:14856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4756 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115645.896287:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff913840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+24:14710:x1876023288392576:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 3246us (3914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115645.896300:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:0.0:1789115645.908200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115645.909642:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288392832 00000100:00100000:2.0:1789115645.909683:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288392832 00000100:00100000:2.0:1789115645.911011:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1789115645.911037:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff911680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+24:14710:x1876023288392832:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789115645.911066:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115645.911096:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d475d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa4003 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.911229:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4764 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.911258:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4764 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.911273:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4764 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789115645.911289:0:16274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789115645.911442:0:16274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4764 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.911451:0:16274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4764 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.911458:0:16274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4764 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.911464:0:16274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115645.911470:0:16274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4764 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.911478:0:16274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4764 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.911508:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:2.0:1789115645.911512:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789115645.911518:0:16274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4764 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.911525:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4764 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.911586:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d475d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4003 expref: 26 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.911598:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dfcf2156300) 00010000:00010000:2.0:1789115645.911601:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789115645.911605:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d475d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4003 expref: 26 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.911616:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1520600, rc 0) 00000100:00100000:2.0:1789115645.911701:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff911680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+25:14710:x1876023288392832:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 676us (3517us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789115645.911709:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1789115645.921076:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115645.925682:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288392960 00000100:00100000:2.0:1789115645.925704:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288392960 00000100:00100000:2.0:1789115645.926101:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:2.0:1789115645.926116:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+25:14710:x1876023288392960:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789115645.926165:0:14855:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789115645.926332:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+25:14710:x1876023288392960:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 219us (5272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115645.926366:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1789115645.933007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115645.933607:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288393216 00000100:00100000:2.0:1789115645.933621:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288393216 00000100:00100000:2.0:1789115645.933705:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1789115645.933720:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+25:14710:x1876023288393216:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789115645.933749:0:14854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115645.933779:0:14854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d4772 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa400a expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789115645.935923:0:14854:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1789115645.935940:0:14854:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789115645.936021:0:14854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789115645.937440:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4779 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.937463:0:14854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4779 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.937477:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4779 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.937590:0:14854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d4772 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa400a expref: 28 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.937614:0:14854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4779 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa400a expref: 27 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.937622:0:14854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dfcc3201000) 00010000:00010000:2.0:1789115645.937638:0:14854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789115645.937642:0:14854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1521a00, rc 0) 00000100:00100000:3.0:1789115645.937963:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+27:14710:x1876023288393216:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 4245us (4970us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1789115645.937974:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:0.0:1789115645.955022:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115645.955140:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288393472 00000100:00100000:3.0:1789115645.955153:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288393472 00000100:00100000:3.0:1789115645.955246:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:3.0:1789115645.955257:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+27:14710:x1876023288393472:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789115645.955347:0:14856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789115645.955372:0:14856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d4779 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa400a expref: 27 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955426:0:14856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dfcc3201000) 00010000:00010000:3.0:1789115645.955436:0:14856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789115645.955458:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4787 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955471:0:14856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4787 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955479:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4787 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955530:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d478e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfe699d94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955554:0:14856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d478e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe699d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955562:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d478e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe699d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955644:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4787 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955652:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4787 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955660:0:14856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4787 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955667:0:14856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115645.955670:0:14856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4787 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955679:0:14856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4787 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955688:0:14856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dfcc3201a00) 00010000:00010000:3.0:1789115645.955690:0:14856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115645.955694:0:14856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4787 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955700:0:14856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d4787 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955710:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d478e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe699d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955722:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d478e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe699d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955728:0:14856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d478e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe699d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955733:0:14856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eba00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1789115645.955735:0:14856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d478e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe699d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955741:0:14856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d478e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe699d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955748:0:14856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xfe699d94 (ffff8dfcf2156600) 00010000:00010000:3.0:1789115645.955751:0:14856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789115645.955753:0:14856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d478e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfe699d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.955759:0:14856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eba00/0xa47abda6516d478e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfe699d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115645.956005:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+26:14710:x1876023288393472:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 748us (999us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789115645.956013:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:0.0:1789115645.958838:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115645.959168:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288393600 00000100:00100000:3.0:1789115645.959181:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288393600 00000100:00100000:3.0:1789115645.960013:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:3.0:1789115645.960030:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff911e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+26:14710:x1876023288393600:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789115645.960372:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789115645.960564:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d4795 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa4011 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.960617:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d479c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.960635:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d479c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.962209:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d479c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.962414:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea200/0xa47abda6516d4795 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4011 expref: 28 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.962441:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ebe00/0xa47abda6516d479c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4011 expref: 27 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115645.962453:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dfcf2156d00) 00010000:00010000:3.0:1789115645.962456:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789115645.962462:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcff9ebe00, rc 0) 00000100:00100000:3.0:1789115645.963784:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff911e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+27:14710:x1876023288393600:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 3749us (4951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115645.963798:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1789115645.969222:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115645.969450:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288393856 00000100:00100000:2.0:1789115645.969464:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288393856 00000100:00100000:2.0:1789115645.969537:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:2.0:1789115645.969549:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+27:14710:x1876023288393856:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789115645.969744:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d47a3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.969825:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d47a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.969840:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d47a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789115645.970322:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789115645.970341:0:14855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 463182958340ns, next at 464182949800ns, rc = 0 00000004:00010000:2.0:1789115645.970566:0:14855:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008764621d reply state 00000000edfa9e8c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d47a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115645.970578:0:14855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789115645.970850:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+29:14710:x1876023288393856:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1299us (1639us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789115645.970858:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00010000:00010000:1.0:1789115645.976799:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d47a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.976822:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d47a3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.976830:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d47a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.976859:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1520600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1789115645.976866:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d47a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.976875:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d47a3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.976898:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dfcf2156d00) 00010000:00010000:1.0:1789115645.976901:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789115645.976908:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d47a3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115645.976915:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520600/0xa47abda6516d47a3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115645.977611:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115645.977854:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288393984 00000100:00100000:2.0:1789115645.977867:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288393984 00000100:00100000:2.0:1789115645.978018:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1789115645.978031:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+28:14710:x1876023288393984:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789115645.978107:0:14854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115645.978171:0:14854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d47aa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa4018 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.978299:0:14854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d47aa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4018 expref: 29 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.978316:0:14854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d47aa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4018 expref: 29 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115645.978341:0:14854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dfcf2156d00) 00010000:00010000:2.0:1789115645.978345:0:14854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789115645.978348:0:14854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1521400, rc 0) 00000100:00100000:2.0:1789115645.978589:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+29:14710:x1876023288393984:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 560us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115645.978610:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1789115645.982819:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115645.983010:0:15540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288394112 00000100:00100000:2.0:1789115645.983024:0:15540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288394112 00000100:00080000:0.0:1789115645.983180:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789115645.983229:0:15540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:2.0:1789115645.983254:0:15540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2353:x1876023288394112:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789115645.987262:0:15540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:2353:x1876023288394112:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 3994us (4441us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789115645.987281:0:15540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1789115645.992353:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115645.992930:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288394368 00000100:00100000:2.0:1789115645.992945:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288394368 00000100:00100000:2.0:1789115645.993030:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1789115645.993042:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+29:14710:x1876023288394368:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789115645.993429:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+30:14710:x1876023288394368:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 387us (1090us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789115645.993456:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:1.0:1789115645.996988:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115645.997168:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288394624 00000100:00100000:3.0:1789115645.997180:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288394624 00000100:00100000:3.0:1789115645.997260:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:3.0:1789115645.997270:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+30:14710:x1876023288394624:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789115645.997661:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+30:14710:x1876023288394624:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 390us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115645.997688:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:0.0:1789115646.000523:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115646.000762:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288394752 00000100:00100000:1.0:1789115646.000775:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288394752 00000100:00100000:1.0:1789115646.000850:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:1.0:1789115646.000862:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+30:14710:x1876023288394752:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789115646.000891:0:14854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789115646.000923:0:14854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f400/0xa47abda6516d47b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa401f expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.001014:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d47b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.001032:0:14854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d47b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.001065:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d47b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789115646.001117:0:14854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789115646.001144:0:14854:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d47b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.001177:0:14854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28f400/0xa47abda6516d47b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa401f expref: 32 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.001200:0:14854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d47b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa401f expref: 31 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.001220:0:14854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dfcf2156d00) 00010000:00010000:1.0:1789115646.001224:0:14854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789115646.001229:0:14854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfccf28ee00, rc 0) 00000100:00100000:1.0:1789115646.001327:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+31:14710:x1876023288394752:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 466us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115646.001336:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:1.0:1789115646.006362:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115646.006621:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288394880 00000100:00100000:2.0:1789115646.006634:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288394880 00000100:00100000:2.0:1789115646.006756:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1789115646.006769:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+6:2353:x1876023288394880:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789115646.006796:0:15543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789115646.006826:0:15543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd7c6652/0xa47abda6516d47bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa4026 expref: -99 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789115646.006862:0:15543:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3bcfd, blocks: 0x1 00010000:00010000:2.0:1789115646.006889:0:15543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1789115646.006895:0:15543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115646.006907:0:15543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd7c6652/0xa47abda6516d47bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4026 expref: 7 pid: 15543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.006929:0:15543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd7c6652/0xa47abda6516d47bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4026 expref: 7 pid: 15543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.006946:0:15543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfcc1520600, rc 0) 00000100:00100000:2.0:1789115646.007026:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:2353:x1876023288394880:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 259us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115646.007034:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1789115646.012532:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115646.012702:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288395136 00000100:00100000:1.0:1789115646.012725:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288395136 00000100:00100000:1.0:1789115646.012800:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:1.0:1789115646.012811:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+31:14710:x1876023288395136:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789115646.012951:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+31:14710:x1876023288395136:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 142us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115646.012959:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:0.0:1789115646.016301:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115646.016502:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288395264 00000100:00100000:1.0:1789115646.016515:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288395264 00000100:00100000:1.0:1789115646.016588:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:1.0:1789115646.016600:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+31:14710:x1876023288395264:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789115646.061807:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+31:14710:x1876023288395264:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 44194us (44509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115646.061832:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000001:00080000:1.0:1789115646.061887:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:1.0:1789115646.061902:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:1.0:1789115646.061907:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000001:00080000:1.0:1789115646.061912:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1789115646.061919:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789115646.064902:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115646.065194:0:15542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288395392 00000100:00100000:3.0:1789115646.065207:0:15542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288395392 00000100:00100000:3.0:1789115646.065301:0:15542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:3.0:1789115646.065312:0:15542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:2350:x1876023288395392:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789115646.065497:0:15542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:2350:x1876023288395392:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 186us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115646.065506:0:15542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:0.0:1789115646.066532:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789115646.066557:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308302720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789115646.066629:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789115646.066969:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308302720 00000100:00100000:2.0:1789115646.066978:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308302720 00000100:00100000:2.0:1789115646.067053:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789115646.067086:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876023308302720:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789115646.067343:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1789115646.067557:0:16738:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789115646.067562:0:16738:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789115646.067565:0:16738:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789115646.067567:0:16738:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789115645 -> 1789115645 00002000:00010000:2.0:1789115646.067570:0:16738:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789115646.067634:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1876023308302720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 550us (1003us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789115646.067643:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1789115646.067749:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dfcfc09b480/2, rc 0, transno 8589934595 00000100:00100000:0.0:1789115646.067757:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876023308302720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789115646.070510:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115646.071147:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288395648 00000100:00100000:2.0:1789115646.071162:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288395648 00000100:00100000:2.0:1789115646.071452:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:2.0:1789115646.071467:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+28:14710:x1876023288395648:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789115646.071550:0:14855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115646.071592:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfccf28ee00/0xa47abda6516d47b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa401f expref: 28 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.071619:0:14855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dfcf2156d00) 00010000:00010000:2.0:1789115646.071625:0:14855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789115646.071667:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d47c6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.071683:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d47c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.071694:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d47c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789115646.072044:0:14855:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b1b74db4 reply state 00000000a6be6a62 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d47c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115646.072073:0:14855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789115646.072816:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+29:14710:x1876023288395648:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1346us (2315us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789115646.072827:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000001:00080000:1.0:1789115646.072993:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1789115646.081990:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:2.0:1789115646.082130:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d47c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.082145:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d47c6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.082154:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d47c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.082161:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1521a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1789115646.082167:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d47c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.082177:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d47c6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.082199:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dfcf2156d00) 00010000:00010000:2.0:1789115646.082202:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789115646.082218:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d47c6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.082226:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521a00/0xa47abda6516d47c6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115646.082589:0:15542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288395776 00000100:00100000:0.0:1789115646.082602:0:15542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288395776 00000100:00100000:0.0:1789115646.082707:0:15542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1789115646.082730:0:15542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd217c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:14710:x1876023288395776:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789115646.082756:0:15542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789115646.082779:0:15542:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d47cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65475a2761aa402d expref: -99 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.082833:0:15542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd7c6652/0xa47abda6516d47bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4026 expref: 8 pid: 15543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.082843:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115646.082849:0:15542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115646.082855:0:15542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d47cd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa402d expref: 8 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.082898:0:15542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd7c6652/0xa47abda6516d47bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4026 expref: 8 pid: 15543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.082913:0:15542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd7c6652/0xa47abda6516d47bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4026 expref: 8 pid: 15543 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115646.082931:0:15542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15542:1876023308302848:192.168.203.31@tcp:104: 00000100:00100000:0.0:1789115646.083051:0:15542:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd0794240 going to sleep for 11 seconds 00000100:00100000:0.0:1789115646.085608:0:15542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15542:1876023308302848:192.168.203.31@tcp:104: 00010000:00010000:0.0:1789115646.085670:0:15542:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d47cd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa402d expref: 8 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.085699:0:15542:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfced9d3c00, rc 0) 00000100:00100000:0.0:1789115646.085785:0:15542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd217c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fed6308d-d83b-4b96-8e21-feae292eb9a7+8:14710:x1876023288395776:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 3058us (3811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115646.085817:0:15542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:1.0:1789115646.089634:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115646.089738:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288395904 00000100:00100000:2.0:1789115646.089750:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288395904 00010000:00010000:2.0:1789115646.089825:0:14839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd7c6652/0xa47abda6516d47bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4026 expref: 8 pid: 15543 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115646.089878:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1789115646.089890:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd217e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+8:2353:x1876023288395904:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115646.089913:0:14839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115646.089946:0:14839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd7c6652/0xa47abda6516d47bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4026 expref: 8 pid: 15543 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.089963:0:14839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd7c6652/0xa47abda6516d47bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4026 expref: 8 pid: 15543 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.089996:0:14839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd7c6652/0xa47abda6516d47bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4026 expref: 8 pid: 15543 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.090018:0:14839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115646.090023:0:14839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789115646.090031:0:14839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d47cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa402d expref: 7 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.090042:0:14839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d47cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa402d expref: 7 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.090101:0:14839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d47cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa402d expref: 7 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115646.090135:0:14839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfc09a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14839:1876023308302976:192.168.203.31@tcp:105: 00000100:00100000:2.0:1789115646.090892:0:14839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfbc1c54e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789115646.095529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115646.095671:0:14839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfc09a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14839:1876023308302976:192.168.203.31@tcp:105: 00010000:00010000:2.0:1789115646.095707:0:14839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115646.095794:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd217e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:2353:x1876023288395904:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 5904us (6175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115646.095808:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:3.0:1789115646.095936:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288396032 00000100:00100000:3.0:1789115646.095947:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288396032 00000100:00100000:3.0:1789115646.096013:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1789115646.096025:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff971e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:2352:x1876023288396032:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789115646.096317:0:15543:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789115646.096321:0:15543:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789115644 00002000:00010000:3.0:1789115646.096325:0:15543:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789115643 00002000:00010000:3.0:1789115646.096327:0:15543:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789115645 -> 1789115644 00002000:00010000:3.0:1789115646.096330:0:15543:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789115646.096361:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff971e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+8:2352:x1876023288396032:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 339us (850us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789115646.096370:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1789115646.100933:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115646.101598:0:15540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288396160 00000100:00100000:2.0:1789115646.101613:0:15540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288396160 00000100:00100000:3.0:1789115646.101884:0:15540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:3.0:1789115646.101897:0:15540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+8:2350:x1876023288396160:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789115646.101965:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000028d76733/0xa47abda6516d47d4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.102010:0:15540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d47cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa402d expref: 8 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.102022:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115646.102027:0:15540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789115646.102033:0:15540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028d76733/0xa47abda6516d47d4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.102093:0:15540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d47cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa402d expref: 8 pid: 15542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.102112:0:15540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d47cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa402d expref: 8 pid: 15542 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115646.102130:0:15540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf84b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15540:1876023308303104:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115646.102266:0:15540:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115646.105779:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115646.105945:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288396288 00000100:00100000:2.0:1789115646.105958:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288396288 00010000:00010000:2.0:1789115646.106013:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d47cd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa402d expref: 9 pid: 15542 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789115646.106075:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1789115646.106087:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+9:2353:x1876023288396288:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789115646.106106:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789115646.106136:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d47cd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa402d expref: 9 pid: 15542 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.106154:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d47cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa402d expref: 9 pid: 15542 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.106189:0:17090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789115646.106213:0:17090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789115646.106220:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028d76733/0xa47abda6516d47d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.106245:0:17090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028d76733/0xa47abda6516d47d4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.106272:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789115646.106345:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+9:2353:x1876023288396288:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 259us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115646.106353:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00010000:00010000:3.0:1789115646.107485:0:15540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad6bc51a/0xa47abda6516d47cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa402d expref: 8 pid: 15542 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115646.107511:0:15540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf84b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15540:1876023308303104:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789115646.107542:0:15540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000028d76733/0xa47abda6516d47d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.107556:0:15540:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000028d76733/0xa47abda6516d47d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.107579:0:15540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028d76733/0xa47abda6516d47d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.107618:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000028d76733/0xa47abda6516d47d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.107628:0:15540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028d76733/0xa47abda6516d47d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.107638:0:15540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028d76733/0xa47abda6516d47d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.107647:0:15540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115646.107652:0:15540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028d76733/0xa47abda6516d47d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.107663:0:15540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028d76733/0xa47abda6516d47d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.107682:0:15540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028d76733/0xa47abda6516d47d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.107691:0:15540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028d76733/0xa47abda6516d47d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115646.107802:0:15540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+7:2350:x1876023288396160:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 5907us (6883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115646.107812:0:15540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1789115646.111994:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115646.112229:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288396544 00000100:00100000:3.0:1789115646.112302:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288396544 00000100:00100000:3.0:1789115646.112526:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1789115646.112540:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff9730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+14:14710:x1876023288396544:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789115646.112658:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d47db lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.112683:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d47db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.112699:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d47db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.113030:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.113043:0:16274:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d47aa lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4018 expref: 15 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.113053:0:16274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.113671:0:16274:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d47aa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4018 expref: 15 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.113707:0:16274:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d47aa lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4018 expref: 15 pid: 14854 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115646.113736:0:16274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf84b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16274:1876023308303232:192.168.203.31@tcp:104: 00000100:00100000:3.0:1789115646.113861:0:16274:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789115646.119444:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115646.119539:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288396672 00000100:00100000:1.0:1789115646.119550:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288396672 00010000:00010000:1.0:1789115646.119602:0:14841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d47aa lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4018 expref: 16 pid: 14854 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115646.119694:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:1.0:1789115646.119706:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc09a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+16:2352:x1876023288396672:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789115646.119735:0:14841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789115646.119744:0:14841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d47aa lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4018 expref: 16 pid: 14854 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.119784:0:14841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d47aa lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4018 expref: 16 pid: 14854 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.119813:0:14841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dfcf2156d00) 00010000:00010000:1.0:1789115646.119820:0:14841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.119832:0:14841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.119840:0:14841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.119863:0:14841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789115646.119937:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc09a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+16:2352:x1876023288396672:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 233us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115646.119946:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00010000:00010000:3.0:1789115646.121000:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1521400/0xa47abda6516d47aa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x65475a2761aa4018 expref: 15 pid: 14854 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115646.121027:0:16274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf84b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16274:1876023308303232:192.168.203.31@tcp:104: 00010000:00010000:3.0:1789115646.121054:0:16274:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.121077:0:16274:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.121083:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789115646.121356:0:16274:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1789115646.121565:0:16274:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1789115646.121616:0:16274:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1789115646.121719:0:16274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf84b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16274:1876023308303360:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789115646.121945:0:16274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115646.122283:0:16274:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcfcfaee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789115646.122375:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308303360 00000100:00100000:3.0:1789115646.122431:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308303360 00000100:00100000:3.0:1789115646.122492:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789115646.122512:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16274:x1876023308303360:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789115646.122520:0:14860:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789115646.122533:0:14860:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789115646.122633:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16274:x1876023308303360:12345-0@lo:1000:mdt00_003.0 Request processed in 121us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115646.122643:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789115646.122712:0:16274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf84b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16274:1876023308303360:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789115646.123489:0:16274:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789115646.123576:0:16274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcfbf84b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16274:1876023308303488:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789115646.123625:0:16274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115646.123657:0:16274:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcc83c9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789115646.123684:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308303488 00000100:00100000:0.0:1789115646.123698:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308303488 00000100:00100000:0.0:1789115646.123819:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789115646.123829:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16274:x1876023308303488:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789115646.124166:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16274:x1876023308303488:12345-0@lo:1000:mdt00_003.0 Request processed in 338us (539us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789115646.124175:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789115646.124298:0:16274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcfbf84b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16274:1876023308303488:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789115646.124348:0:16274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124359:0:16274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124367:0:16274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124375:0:16274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115646.124402:0:16274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124412:0:16274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124432:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dfcf2156d00) 00010000:00010000:0.0:1789115646.124447:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789115646.124453:0:16274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124460:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea000/0xa47abda6516d47e2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124498:0:16274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d473a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124505:0:16274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d473a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124512:0:16274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d473a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124517:0:16274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcc1520000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115646.124520:0:16274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d473a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124526:0:16274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d473a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124534:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:0.0:1789115646.124536:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789115646.124546:0:16274:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d4741 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ffc expref: 18 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124559:0:16274:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d4741 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ffc expref: 18 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124569:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d4741 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ffc expref: 18 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.124613:0:16274:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb800/0xa47abda6516d4741 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x65475a2761aa3ffc expref: 18 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115646.124630:0:16274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcd35f52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16274:1876023308303616:192.168.203.31@tcp:105: 00000100:00100000:0.0:1789115646.124923:0:16274:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dfcd0794840 going to sleep for 11 seconds 00000100:00100000:1.0:1789115646.129839:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115646.129937:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288396800 00000100:00100000:3.0:1789115646.129951:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288396800 00000100:00100000:3.0:1789115646.130027:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1789115646.130039:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcc13fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+19:14709:x1876023288396800:12345-192.168.203.31@tcp:49:dd.0 00000100:00100000:0.0:1789115646.130361:0:16274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcd35f52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16274:1876023308303616:192.168.203.31@tcp:105: 00010000:00010000:0.0:1789115646.130419:0:16274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d473a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130434:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcc1520000/0xa47abda6516d473a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130479:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d47e9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130497:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d47e9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130512:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d47e9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130523:0:16274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d47e9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130531:0:16274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d47e9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130537:0:16274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d47e9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130565:0:16274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115646.130570:0:16274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d47e9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130578:0:16274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d47e9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130594:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:0.0:1789115646.130597:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789115646.130601:0:16274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d47e9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130607:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfced9d3600/0xa47abda6516d47e9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130617:0:16274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d47db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130623:0:16274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d47db lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130628:0:16274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d47db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130632:0:16274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ea600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1789115646.130635:0:16274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d47db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130640:0:16274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d47db lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130658:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dfcc3201300) 00010000:00010000:0.0:1789115646.130661:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789115646.130664:0:16274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d47db lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.130669:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9ea600/0xa47abda6516d47db lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115646.131771:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcc13fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+19:14709:x1876023288396800:12345-192.168.203.31@tcp:49:dd.0 Request processed in 1720us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115646.131788:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1789115646.132004:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff9730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+18:14710:x1876023288396544:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 19465us (20021us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789115646.132015:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000020:00080000:0.0:1789115646.132021:0:16274:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789115646.132207:0:14889:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789115646.132214:0:14889:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789115646.132434:0:14889:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789115646.132442:0:14889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789115646.137486:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115646.137619:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288397056 00000100:00100000:3.0:1789115646.137632:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288397056 00000100:00100000:3.0:1789115646.137710:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:3.0:1789115646.137733:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+18:14710:x1876023288397056:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789115646.138654:0:14857:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789115646.138795:0:14857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1789115646.138856:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d47f0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.138877:0:14857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d47f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.138901:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d47f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.138912:0:14857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d47f0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.138919:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d47f0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.138926:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d47f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.138946:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789115646.139074:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fed6308d-d83b-4b96-8e21-feae292eb9a7+20:14710:x1876023288397056:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 1340us (1599us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1789115646.139085:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000020:00080000:3.0:1789115646.139092:0:14857:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789115646.142271:0:16179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789115646.142292:0:16179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d47f0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.142306:0:16179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9eb000 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115646.142311:0:16179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d47f0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.142323:0:16179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d47f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.142347:0:16179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dfcf2156d00) 00010000:00010000:0.0:1789115646.142376:0:16179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789115646.142409:0:16179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d47f0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.142417:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfcff9eb000/0xa47abda6516d47f0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.142444:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115646.142447:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789115646.142449:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115646.319126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115646.321641:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115646.321687:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1789115646.323424:0:15547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288397184 00000100:00100000:1.0:1789115646.323424:0:15546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288397312 00000100:00100000:2.0:1789115646.323442:0:15547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288397184 00000100:00100000:1.0:1789115646.323442:0:15546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288397312 00000100:00100000:2.0:1789115646.323519:0:15547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288397440 00000100:00100000:2.0:1789115646.323522:0:15547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288397440 00000100:00100000:0.0:1789115646.323669:0:15548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1789115646.323683:0:15548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+9:2352:x1876023288397184:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:0.0:1789115646.323765:0:15548:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa3bcfc, atime: 0x6aa3bcfb, ctime: 0x6aa3bcfc, blocks: 0x1 00010000:00010000:0.0:1789115646.323780:0:15548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d47f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.323810:0:15548:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1789115646.323816:0:15548:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115646.323826:0:15548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d47f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.323845:0:15548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d47f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115646.326328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115646.326354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115646.326373:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1789115646.332642:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115646.333560:0:15546:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789115646.333578:0:15546:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789115646.335144:0:15546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288397568 00000100:00100000:1.0:1789115646.335166:0:15546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288397568 00000100:00100000:1.0:1789115646.335273:0:15546:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789115646.335285:0:15546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288397696 00000100:00100000:1.0:1789115646.335289:0:15546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288397696 00000100:00100000:1.0:1789115646.335307:0:15546:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789115646.335312:0:15546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288397824 00000100:00100000:1.0:1789115646.335315:0:15546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288397824 00000100:00100000:1.0:1789115646.335352:0:15546:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789115646.335358:0:15546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288397952 00000100:00100000:1.0:1789115646.335361:0:15546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288397952 00000100:00100000:1.0:1789115646.335618:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115646.335644:0:15546:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789115646.335652:0:15546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288398080 00000100:00100000:1.0:1789115646.335655:0:15546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288398080 00000100:00100000:3.0:1789115646.342761:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:3.0:1789115646.344392:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+15:2353:x1876023288397312:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:3.0:1789115646.344474:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d47fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.344519:0:17095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115646.344525:0:17095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115646.344533:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d47fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.344552:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d47fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789115646.441826:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789115646.484642:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1789115646.484662:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1789115646.486620:0:15548:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1789115646.486630:0:15548:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789115644 -> 1789115645 00002000:00010000:0.0:1789115646.486634:0:15548:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789115644 -> 1789115645 00002000:00010000:0.0:1789115646.486636:0:15548:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4099 00010000:00010000:0.0:1789115646.486666:0:15548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d47f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.486678:0:15548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d47f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.486686:0:15548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d47f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.486693:0:15548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3600 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115646.486697:0:15548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d47f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.486705:0:15548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d47f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.486723:0:15548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d47f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.486730:0:15548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d47f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115646.486836:0:15548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+15:2352:x1876023288397184:12345-192.168.203.31@tcp:4:dd.0 Request processed in 163151us (167720us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789115646.486847:0:15548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1789115646.486882:0:15548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1789115646.486894:0:15548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+14:2352:x1876023288397568:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:0.0:1789115646.486934:0:15548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d4805 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.486946:0:15548:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115646.486950:0:15548:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115646.486956:0:15548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d4805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.486968:0:15548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d4805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789115646.574010:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1789115646.578127:0:17095:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 4194304 00002000:00010000:1.0:1789115646.578139:0:17095:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4099 -> 6151 00010000:00010000:1.0:1789115646.578156:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d47fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.578170:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d47fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.578179:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d47fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.578186:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ebc00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115646.578191:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d47fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.578200:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d47fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.578220:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d47fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.578262:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d47fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115646.578372:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+14:2353:x1876023288397312:12345-192.168.203.31@tcp:4:dd.0 Request processed in 235589us (256739us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789115646.578424:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1789115646.578465:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:1.0:1789115646.578477:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+13:2352:x1876023288397696:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:1.0:1789115646.578510:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d480c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.578523:0:17095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115646.578527:0:17095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115646.578533:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d480c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.578545:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d480c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789115646.634537:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1789115646.636553:0:15548:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:1.0:1789115646.636564:0:15548:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1789115646.636578:0:15548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d4805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.636592:0:15548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d4805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.636612:0:15548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d4805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.636620:0:15548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2a00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115646.636625:0:15548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d4805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.636634:0:15548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d4805 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.636653:0:15548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d4805 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.636661:0:15548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8d324c6/0xa47abda6516d4805 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115646.636757:0:15548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+13:2352:x1876023288397568:12345-192.168.203.31@tcp:4:dd.0 Request processed in 149863us (310439us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789115646.636767:0:15548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1789115646.636802:0:15548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1789115646.636813:0:15548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+12:2353:x1876023288397824:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:1.0:1789115646.636844:0:15548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4813 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.636856:0:15548:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115646.636865:0:15548:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789115646.636872:0:15548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.636884:0:15548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789115646.684727:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:0.0:1789115646.691580:0:17095:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1789115646.691588:0:17095:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1789115646.691605:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d480c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.691617:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d480c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.691626:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d480c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.691634:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28ea00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115646.691639:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d480c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.691647:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d480c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.691678:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d480c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.691686:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4ab3665/0xa47abda6516d480c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115646.691785:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+12:2352:x1876023288397696:12345-192.168.203.31@tcp:4:dd.0 Request processed in 113306us (365424us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789115646.691797:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1789115646.691828:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1789115646.691839:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+11:2353:x1876023288397952:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:0.0:1789115646.691872:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d481a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.691885:0:17095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115646.691890:0:17095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115646.691896:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d481a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.691908:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d481a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789115646.731888:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:3.0:1789115646.739919:0:15548:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1789115646.739929:0:15548:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1789115646.739945:0:15548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.739959:0:15548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.739969:0:15548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4813 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.739976:0:15548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfccf28fe00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115646.739981:0:15548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4813 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.739990:0:15548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4813 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.740031:0:15548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4813 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.740039:0:15548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030b560fe/0xa47abda6516d4813 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115646.740124:0:15548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+11:2353:x1876023288397824:12345-192.168.203.31@tcp:4:dd.0 Request processed in 103311us (413746us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789115646.740134:0:15548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1789115646.740166:0:15548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1789115646.740177:0:15548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff973c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+10:2353:x1876023288398080:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:3.0:1789115646.740207:0:15548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d4821 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.740219:0:15548:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115646.740224:0:15548:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789115646.741667:0:15548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d4821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.741690:0:15548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d4821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789115646.777351:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:0.0:1789115646.777534:0:17095:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:0.0:1789115646.777552:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d481a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.777579:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d481a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.777588:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d481a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.777595:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d2400 already unused, calling callback (ffffffffc1728550) 00010000:00010000:0.0:1789115646.777600:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d481a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.777609:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d481a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.777629:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d481a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.777636:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002588431d/0xa47abda6516d481a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789115646.777860:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+10:2353:x1876023288397952:12345-192.168.203.31@tcp:4:dd.0 Request processed in 86020us (445229us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789115646.777869:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1789115646.777896:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1789115646.777907:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+9:2352:x1876023288397440:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:0.0:1789115646.777935:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d4828 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.777950:0:17095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115646.777953:0:17095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789115646.777957:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d4828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789115646.777966:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d4828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789115646.814074:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1789115646.814898:0:15548:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1789115646.814917:0:15548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d4821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.814946:0:15548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d4821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.814955:0:15548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d4821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.814964:0:15548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfcff9ebc00 already unused, calling callback (ffffffffc1728550) 00010000:00010000:3.0:1789115646.814968:0:15548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d4821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.814978:0:15548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d4821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.815002:0:15548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d4821 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789115646.815010:0:15548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000595a9ad3/0xa47abda6516d4821 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789115646.815149:0:15548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff973c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+9:2353:x1876023288398080:12345-192.168.203.31@tcp:4:dd.0 Request processed in 74969us (479532us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789115646.815160:0:15548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000001:00080000:0.0:1789115646.853022:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:1.0:1789115646.853197:0:17095:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1789115646.853214:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d4828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.853235:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d4828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.853244:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d4828 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.853252:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfced9d3600 already unused, calling callback (ffffffffc1728550) 00010000:00010000:1.0:1789115646.853258:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d4828 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.853267:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d4828 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.853286:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d4828 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789115646.853294:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e1d0795/0xa47abda6516d4828 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789115646.853650:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2352:x1876023288397440:12345-192.168.203.31@tcp:4:dd.0 Request processed in 75743us (531957us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789115646.853661:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1789115647.139826:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308303872:0@lo:400:kworker.0 00000100:00100000:1.0:1789115647.139851:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308304000:0@lo:400:kworker.0 00000100:00100000:0.0:1789115647.139922:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff972580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91237388-4e21-4f8d-88fa-5d733c21b708:3308:1876023308303744:0@lo:400:kworker.0 00000100:00100000:2.0:1789115647.140082:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff9712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308304128:0@lo:400:kworker.0 00000100:00100000:1.0:1789115647.142139:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115647.142566:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff971680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308304512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789115647.144835:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115647.144901:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308304256:0@lo:400:kworker.0 00000100:00100000:0.0:1789115647.145094:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789115647.145624:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308303744 00000100:00100000:0.0:1789115647.145633:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308303744 00000100:00100000:0.0:1789115647.145680:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789115647.145689:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfcea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+19:3308:x1876023308303744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115647.145748:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfcea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91237388-4e21-4f8d-88fa-5d733c21b708+19:3308:x1876023308303744:12345-0@lo:400:kworker.0 Request processed in 60us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115647.145976:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789115647.146026:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308304256 00000100:00100000:0.0:1789115647.146031:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308304256 00000100:00100000:0.0:1789115647.146068:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789115647.146075:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308304256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115647.146604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115647.146645:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dfcff972940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308304384:0@lo:400:kworker.0 00000100:00100000:3.0:1789115647.146697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115647.146735:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308304000 00000100:00100000:3.0:1789115647.146863:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308304000 00000100:00100000:3.0:1789115647.146904:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308303872 00000100:00100000:3.0:1789115647.146908:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308303872 00000100:00100000:0.0:1789115647.146916:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876023308304256:12345-0@lo:400:kworker.0 Request processed in 840us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115647.146924:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789115647.146935:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789115647.146944:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308304384 00000100:00100000:3.0:1789115647.146945:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff970b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308304000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115647.146951:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308304384 00000100:00100000:0.0:1789115647.146989:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789115647.146993:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff970b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308304000:12345-0@lo:400:kworker.0 Request processed in 48us (4860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115647.147002:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308304384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115647.147005:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789115647.147026:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789115647.147034:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308303872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789115647.147065:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876023308304384:12345-0@lo:400:kworker.0 Request processed in 66us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789115647.147075:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789115647.147076:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876023308303872:12345-0@lo:400:kworker.0 Request processed in 40us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115647.147086:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1789115647.147255:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789115647.147260:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789115647.147337:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876023308303872:0@lo:400:kworker.0 00000100:00100000:3.0:1789115647.147364:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff972940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876023308304384:0@lo:400:kworker.0 00000100:00100000:3.0:1789115647.147532:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff972580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91237388-4e21-4f8d-88fa-5d733c21b708:3308:1876023308303744:0@lo:400:kworker.0 00000100:00100000:2.0:1789115647.147544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789115647.147548:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876023308304256:0@lo:400:kworker.0 00000100:00100000:3.0:1789115647.147587:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308304128 00000100:00100000:3.0:1789115647.147591:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308304128 00000100:00100000:3.0:1789115647.147616:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789115647.147622:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfc098b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308304128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789115647.147656:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfc098b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876023308304128:12345-0@lo:400:kworker.0 Request processed in 34us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789115647.147672:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789115647.148839:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff9712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876023308304128:0@lo:400:kworker.0 00000100:00100000:1.0:1789115647.150784:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789115647.150895:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1789115647.150901:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dfcfc09b480, transno 8589934595 00000004:00080000:1.0:1789115647.150922:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1789115647.150946:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff970780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308304000:0@lo:400:kworker.0 00000100:00100000:2.0:1789115647.154448:0:15545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023308304512 00000100:00100000:2.0:1789115647.154462:0:15545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023308304512 00000100:00100000:2.0:1789115647.157256:0:15545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789115647.157279:0:15545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcff972d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308304512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789115647.157322:0:15545:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:2.0:1789115647.157743:0:15545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcff972d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876023308304512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 472us (6963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115647.157751:0:15545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789115647.157849:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dfcff971680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876023308304512:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789115647.461686:0:14842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789115648.483694:0:16179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789115648.485407:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115648.485446:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115648.485469:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115648.485491:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115648.485507:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115648.485524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1789115648.485546:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1789115648.485570:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288398464 00000100:00100000:0.0:1789115648.485570:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288398720 00000100:00100000:1.0:1789115648.485578:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288398464 00000100:00100000:0.0:1789115648.485578:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288398720 00000100:00100000:0.0:1789115648.485633:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288398336 00000100:00100000:0.0:1789115648.485636:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288398336 00000100:00100000:2.0:1789115648.485700:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288398208 00000100:00100000:2.0:1789115648.485704:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288398208 00000100:00100000:2.0:1789115648.485736:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:2.0:1789115648.485745:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcfbf58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+13:2351:x1876023288398208:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115648.485811:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288398976 00000100:00100000:1.0:1789115648.485815:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288398976 00000100:00100000:1.0:1789115648.485830:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288398592 00000100:00100000:1.0:1789115648.485832:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288398592 00000100:00100000:1.0:1789115648.485842:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876023288398848 00000100:00100000:1.0:1789115648.485844:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876023288398848 00000100:00100000:1.0:1789115648.485857:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1789115648.485863:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2351:x1876023288398464:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1789115648.485927:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcfbf58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:008edc47-34ab-4767-b919-a366055c99eb+13:2351:x1876023288398208:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 182us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789115648.485935:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:0.0:1789115648.491676:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1789115648.491690:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcd35f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:2351:x1876023288398720:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115648.493347:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2351:x1876023288398464:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 7473us (7889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115648.493379:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1789115648.493431:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1789115648.493442:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35b98319-ecbc-48a4-98d6-b960fe7c7d67+5:2351:x1876023288398976:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115648.493489:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35b98319-ecbc-48a4-98d6-b960fe7c7d67+5:2351:x1876023288398976:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 50us (7997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115648.493496:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1789115648.493514:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1789115648.493521:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2351:x1876023288398592:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115648.493546:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+5:2351:x1876023288398592:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (8020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115648.493552:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1789115648.493565:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1789115648.493574:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaadad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35b98319-ecbc-48a4-98d6-b960fe7c7d67+5:2351:x1876023288398848:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115648.493598:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaadad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35b98319-ecbc-48a4-98d6-b960fe7c7d67+5:2351:x1876023288398848:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (8052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115648.493604:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1789115648.512662:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1789115648.512689:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfcdaad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+20:2351:x1876023288398336:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1789115648.512770:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcdaad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed6308d-d83b-4b96-8e21-feae292eb9a7+20:2351:x1876023288398336:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 94us (27261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115648.512780:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00080000:1.0:1789115648.512840:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789115648.512854:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789115648.512858:0:14850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789115648.525105:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfcd35f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b98319-ecbc-48a4-98d6-b960fe7c7d67+6:2351:x1876023288398720:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 33407us (39622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789115648.525121:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000001:02000400:2.0:1789115648.576678:0:17133:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1789115649.509055:0:14843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30294 lines, 30294 kept, 0 dropped, 0 bad.